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DIVERSITY OF SELF ENDORSEMENTS AS A 
MEASURE OF INDIVIDUAL DIFFERENCES 
IN PERSONALITY 


LOUIS L, McQUITTY 
University of Illinois 

Purpose 

The research outlined herein represents an effort toward the 
measurement of mental health. It is hypothesized that the 
dichotomy between mental hospital patients and community 
persons is indicative of an underlying continuum in which the 
mental health of each person shades into the mental health of 
others by imperceptible and now unmeasured degrees. 

Method — General 

The method here outlined for studying this hypothesized 
mental health continuum developed out of a comparative 
consideration by the investigator of mental hospital patients 
and community persons. The purpose of the consideration 
was to search for a single characteristic in which nearly all 
mental hospital patients appear to differ from community 
persons. This single factor characteristic was then hypothe- 
sized to represent a mental health continuum. The nature 
of the hypothesized characteristic serves as a guide to deter- 
mine the initial content of a trial instrument for measuring 
mental health, Using the hypothesis and a criterion of internal 
consistency, the instrument is standardized on community 
persons. The validity of the instrument for measuring mental 
health is indicated by an empirical determination of the ex- 
tent to which the instrument differentiates between community 
persons and mental hospital patients. 

Evidence for the Hypothesis 

A single characteristic in which nearly all mental hospital 
patients differ from community persons is indicated by at 
least three lines of evidence, These are as follows : 
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I. Theoretical. — Lecky in his book, Self-Consistency (. 4 
Theory of Personality ) (i), maintains that predictable and 
consistent behavior is characteristic of mental stability and that 
the opposite kind of behavior is indicative of mental insta- 
bility. This view of his is summarized in the following quota- 
tions : 

i. The main scientific issue at stake in the controversy is 
the predictability of behavior. Our position is that predict- 
ability is a function of stability and therefore of the basic need 
for consistent self organization (p. 19). 

a. This compulsion to unify and harmonize the system 
of ideas by which we live provides the basis for the dynamic as- 
pect of the theory It is only when a person is unable to rid 
himself of inconsistencies that psychological problems arise (p. 
137 )- 

1. Clinical Observations and Interpretations . — Lecky ’s view 
of mental stability may be supported with remarks from Rogers 
(5) in his 1947 American Psychological Association Presi- 
dential Address. Rogers says of these remarks, that they were 
“presented as clinical observations and tentative hypothesis, 
quite apart from any relationships to past or present thinking 
in the field of psychology,” (p. 366) . The remarks from Rogers 
which seem to support Lecky’s view of mental stability are as 
follows . 

1. When all of the organic perceptual experiences — the 
experiencing of attitudes, impulses, abilities, and disabilities, 
the experiencing of others and of reality — when all of these per- 
ceptions are freely assimilated into an organized and consistent 
system, available to consciousness, then psychological ad- 
justment or integration might be said to exist (p. 364). 

1 . It might be proposed that the tensions called psy- 
chological maladjustment exist when the organized concept of 
self (conscious or available to conscious awareness) is not in 
accord with the perceptions actually experienced (p. 365). 

3. Empirical Evidence. — Empirical evidence which can be 
used m support of the views of Lecky and Rogers, just out- 
lined, is found in Zubin’s studies of response patterns in per- 
sonality adjustment inventories. Zubin (6) has treated the 
individual answers to questions of personality-adjustment in- 
ventories in combinations, A triad combination is illustrated 
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by “yes” to question one, “yes” to question two, and “no” to 
question three. Other illustrations of triads are any of the 
other combinations of answers to the three questions. Zubin 
has isolated questions for which the characteristic answer com- 
binations of community persons differ from the characteristic 
answer patterns of mental hospital patients. Zubin's inter- 
pretation of his results is quoted as follows: 

i. Apparently, both the normal and the abnormal groups 
show considerable pattern integration. The normals, however, 
yield more integration than the abnormals (p. 41 1), 

1. It is a moot question whether insanity is characterized by 
the total breakdown of the normal patterns of response 
involved in thought or whether it is characterized by the estab- 
lishment of new, queer, and abnormal patterns of response. 
The results of this study indicate the possibility that both proc- 
esses may take place (p. 41a). 

These lines of evidence indicate that it is reasonable to hypo- 
thesize, for investigation, a personality factor which restricts 
community persons in the diversity of responses that they give 
in a standardized situation. This restrictive factor is pre- 
sumably less effective in mental hospital patients than com- 
munity persons. In a clinical situation a patient is not re- 
stricted from making the two following statements in close 
juxtaposition : 

1. “My dearest friend just died.” 

1, “I am the happiest person on earth.” 

Neither of these statements, considered separately, is in- 
dicative of mental illness. Considered jointly, in relationship 
to the hypothesis herein proposed, they are thought to be 
indicative of mental illness. They are widely diverse responses, 
in the sense that no one community person usually gives both 
of them near simultaneously in the same situation. 

Method — Statistical 

The statistical methods here described for investigating the 
hypothesized factor of individual differences in the diversity 
of responses have been previously outlined (3). Their im- 
portance for understanding both the factor and the additional 
research here reported make it desirable to describe them again. 
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Measurement of the factor under consideration is de- 
pendent in part upon an index of the diversity of responses 
under standardized conditions. The typical personality in- 
ventory represents a standardized question situation which 
solicits one of three responses to each question. When these 
questions are studied in pairs, there is then one of nine pairs of 
answers solicited to each two questions. 

Consider, for example the two following questions : 

i. Do you enjoy taking big chances? Y N ? 
i. Do you like to be admired by others? Y N ? 

Each of these questions has the following possible answers: 

Y— for “Yes” 

N— for “No” 

? — for undecided. 

The nine possible pairs are then Yi Y 2 , Yi N», Yi ?», N x Yj, 
Ni N„ Ni ?2, ?i Y2, ?i Nj, and ?i ? 2 . 

After administering these questions to a group of community 
persons, an index of diversity is computed for the paired an- 
swers. This index is illustrated in the case of pair Yj Y,. 
Suppose the following tabulation resulted from administering 
the above two questions to 100 community persons: 

Answers Y, N, ?, Y. N, ? 

Number 40 17 43 55 1 < 20 

Answers Y.Y, Y,N, Y,?, N,Y, N,N, N,?, ?,Y, ?,N, ?,?, 

Number 1 J 10 5 Jo } 2 20 10 D 

The above table shows that 40 persons answered "yes” to 
question one; 55 answered “yes” to question two; and 25 an- 
swered “yes” to both questions one and two. An index of the 
diversity between yesi and yes 2 is then given by the formula: 



It will be noted that this index varies from 0.00 to r.oo, that 
1. 00 means minimal diversity and that the diversity increases as 
the index decreases to 0.00. 

The next problem is to convert the index of diversity into 
some linear measure of diversity. This involves either a 
mathematical determination of the relationship between index 
and linear measurement or an assumption of the relationship. 
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The latter alternative is followed here. The validity of the 
assumption can be subsequently investigated, and this is 
planned for a later study. The investigation of the validity 
of the assumption is postponed until later because it is ex- 
tremely laborious if applied to all questions of the inventory. 
The postponement enables the investigator to apply it to 
selected questions chosen in accordance with indices of ef- 
fectiveness in the measurement of the factor under considera- 
tion. 

The relationship between the index and the linear measure 
of diversity is here assumed to be that given by the normal 
curve of probability, where the index equals the ordinate “Y” 
and the linear measure equals the abscissa “X,” expressed in 
terms of deviation from the mean. The equation of the rela- 
tionship between the two variables is then that represented by 
the normal curve of probability. Using this assumption, the 
linear diversity “X” between two answers can be found in pre- 
pared tables computed from the formula for the normal curve. 
The tables used are those in which the maximum ordinate is 
one. These tables are entered with the value of Y, i.e., the 
empirically determined index of diversity, to obtain the value 
of X, the linear measure of diversity. 

It has just been shown how pairs of answers can be scaled 
according to the degree of diversity between the answers. 
This could be done for all possible pairs of answers to theques- 
tions of a personality inventory, comparing the answers of 
each question with those of every other question. An alterna- 
tive method is to compare those of question one with those of 
two, those of two with those of three, those of three with those 
of four, etc. This latter method was chosen because it gives a 
greater coverage of questions without being prohibitive in the 
amount of statistical computations. A wide range of coverage 
of questions is considered desirable because so little is now 
known concerning the type of questions that may eventually 
prove to be most fruitful. 

After pairs of answers have been scaled as herein outlined, 
each subject’s score is obtained by taking a composite of the 
scale values of' the pairs of answers given by him . 1 In this 

1 See ( 3 ) for the method of computing composite scores, 
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connection, it will be remembered that each subject gives but 
two answers to each two questions, one answer to each ques- 
tion of the pair. These two answers represent one pair of 
answers out of a total of nine possible pairs of answers, all of 
which usually have different scale values of diversity. 

Related Research Findings 

Before developing further the research herein reported, it 
is well to summarize as background material, some of the find- 
ings of the study in which the statistical methods for measuring 
diversity of response were developed (3). These findings are 
briefly outlined as follows : 

1. Two personality inventories, the Bernreuter Personality 
Inventory and the Strong I ocational Interest Blank, widely 
different in content, gave a correlation coefficient of 0.63 
=b ,04 when scaled and scored by the method herein out- 
lined. This coefficient was obtained using mental hos- 
pital patients and college students as subjects in a com- 
bined group. This finding indicates that there is a psy- 
chological factor which determines the relative diversity 
of answers that individuals give to the questions of per- 
sonality inventories 

2. On this factor, the scores of male mental hospital patients 
differ significantly from those of male undergraduate 
college students. (The critical ratio of the difference 
between the two mean scores of the two groups studied 
is 1009 for the more sensitive of the two personality 
inventories used.) 

3. When the two questions of a pair tend to be synonymous 
in meaning, though using different words, they are less 
effective in differentiating between male undergraduate 
college students and male mental hospital patients. Two 
examples of highly synonymous pairs follow : 

1. a. Do you enjoy being admired by others? 
b. Do you enjoy being praised by others? 

2. a. Would you like, dislike or be indifferent to being a 

marine engineer? 

b. Would you like, dislike or be indifferent to being a 
mechanical engineer? 
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A highly diverse pair of answers to the questions of example 
“i” would be “yes” to question “la” and “no” to question 
“ib.” This diversity is so great that even mental hospital 
patients often give a less diverse pair of answers, such as 
“yes” to “ia” and “yes” to “ lb” or “no” to “la” and “no” to 
“ ib.” When the degree of diversity is less obvious than it is in 
the above examples, then mental hospital patients give more 
diverse answers than do college students. 

A statistical criterion was developed for measuring the ex- 
tent to which two questions are synonymous (3, pp. 92—94). 
It was shown to be effective in selecting those questions which 
differentiate more effectively between male college students 
and male mental hospital patients It was also shown that 18 
of the most effective items on this criterion when combined into 
a single sub-test have a factor loading equal to or greater than 
the 72 items lowest in the criterion. (The factor loading for 
the sub-test of 18 items is .56, and for the sub-test of 72 items 
it is .50, based on a study of 47 college students. There is no 
overlap of items between the four sub-tests used in the study.) 
This criterion is hereinafter referred to as criterion one. 


Present Research 

We now have the background for outlining the research of 
the present study. In this connection, it will be recalled from 
the above discussion that criterion one deals with a single aspect 
of pairs of questions, namely the extent to which the two ques- 
tions tend to be synonymous. There may be other charac- 
teristics of questions which influence their effectiveness in the 
measurement of the factor under consideration. To discover 
some of these characteristics represents the purpose of the 
study now being outlined. 

Another criterion of the efficiency of each pair of questions 
was computed and substantiated as effective by means of the 
following analysis: 

I. As outlined in the previously mentioned study of this 
factor, the Bemreuter Personality Inventory was admin- 
istered to 47 male college students and to 36 mental hos- 
pital patients (3, p, 87). These results were further 
analyzed in this study. 
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2. For each subject, there is a composite score of the diversity 
of answers for the first 72. pairs of questions of the in- 
ventory. Only the first 72 pairs were scaled for diversity 
because of the large amount of statistical work involved. 

3. There is also, for each subject, a score for each pair of 
questions of the study. All scores are in equivalent 
units. 

4. The mean of differences between the composite scores and 
the scores on any given pair of questions represents an 
index of internal consistency and this index is hereinafter 
referred to as criterion two. It was computed using the 
result of students only. 

5. The Eernreuter Inventories which had been scored for 
diversity of answers, using 72 pairs, were now re-scored 
for both patients and students using only the 36 pairs 
which have the smaller mean deviations (criterion two). 
With the number of pairs reduced from 72 to 36, the criti- 
cal ratio of the difference in mean scores between the two 
groups, patients and students, increased from 10.09 to 
11.97. This result indicates that criterion two is effective 
in picking out the more discriminating pairs of questions. 

The content of the efficient pairs of questions was reviewed 
in relationship to the less-efficient in an effort to discover psy- 
chological meaning in the differences between them. If the 
nature of the difference can be described, then this description 
should be effective in selecting additional items for measuring 
the factor under consideration. Listed below are the four most 
efficient and the four most inefficient pairs of questions, based 
on criterion two.’ 


Efficient Pairs 

1. Do athletics interest you more than intellectual affairs? 
a. Do you consider yourself a rather nervous person? 
r. Do you feel self-conscious in the presence of superiors in the 
academic world? 

1 sleep? eaS °^ en rU ” tllroug *' your ^ cad so t * lat you cannot 

1. Does it bother you to have people watch you at work even 
when you do well? 


‘Permission to quote these items from R. G. Bernreuter’s Persona Hit Intent am 
SunforflfnWemty.VaWornia ““ pubUsher - the Stanford University Press, 
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2. Do you often experience periods of loneliness? 

i, Do you find that telling others of your own personal good 
news is the greatest part of the enjoyment of it? 

i. Do you often feel lonesome when you are with other people? 

Inefficient Pairs 

i . Do you dislike finding you way about in strange places? 

a. Are you easily discouraged when the opinions of others differ 
from your own? 

I, Are you careful not to say things to hurt other 'peoples' feel- 
ings? 

i. Are you easily moved to tears? 

1. Do you make new friends easily? 

2. If you are dining out, do you prefer to have someone else or- 
der dinner for you? 

1 . Do you usually feel a great deal of hesitancy over borrowing 
an article from an acquaintance? 

2. Are you greatly embarrassed if you have greeted a stranger 
whom you have mistaken for an acquaintance? 

In studying the efficient and inefficient pairs of questions, it 
appears that the answers to the latter questions can usually 
be based on more objective criteria than can answers to the 
former group. This difference between the questions indicates 
that criterion two yields psychologically meaningful results, and 
suggests that these observed differences can be used in prepar- 
ing additional inventory questions which should result in 
effective measurement of the psychological factor under con- 
sideration. 


General Interpretation 

The findings indicate that there is a psychological factor of 
individual differences which restricts people in the diversity of 
their answers to the questions of personality inventories. This 
factor appears to be related to observational differences in 
groups of people in that male mental hospital patients give 
more diverse answers than do male college students. Person- 
ality inventory questions which have to be answered on the 
basis of subjective criteria seem on the average to be more sen- 
sitive than those which can be answered on the basis of objective 
criteria. This last conclusion may be related to the observation 
that many mental hospital patients appear to be well integrated 
in certain mental content areas. These areas may be ones 
which the patients regard from objective points of view. It 
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may be that these patients are much less integrated only in 
those areas which they regard from more subjective points of 
view. This possible distinction in degree of integration may 
be related to the finding that pairs of questions which are 
highly synonymous are on the average less effective measures 
than are less synonymous pairs. Perhaps even mental hospital 
patients regard it too obvious a contradiction to give diverse 
answers to synonymous questions. This may be because syn- 
onymous questions tend to demand an objective consideration, 
especially when the two questions appear in juxtaposition as 
they did in the studies here considered. These possible inter- 
pretations can be related to certain theoretical positions in the 
field of personality. 

It is interesting to consider the findings herein outlined rela- 
tive to Lewin’s theory of personality (2) . Particularly sig- 
nificant in this connection is his statement that “within mind 
there are regions of extremely various degrees of coherence — .” 
(a, p. 57). This may be the basis for our finding that sub- 
jectively regarded questions seem to be more sensitive to the 
factor under consideration. It may be that the questions which 
we have described as requiring objective answers tend to tap 
the“reality levels’’ of the "psychical energies.” In considering 
this possibility, it is helpful to realize that from Lewin’s point 
of view, “The functional firmness of the wall between the self 
and the environment depends not only upon the age but upon 
the individual characteristics of the person” (2, p. 108). 
This may be one of the reasons why there is not a clear cut 
distinction on the basis of subjectivity — objectivity between 
our efficient and inefficient pairs of questions. Some of the 
questions that are objectively regarded by some subjects are 
subjectively regarded by others, and vice versa, depending on 
the lines of demarcation in the individual subjects between self 
and environment. 

Researches on Interpretation 

The theoretical positions just outlined suggest that the 
factor under consideration may be related to personality in- 
tegration, This suggestion is supported by the finding that 
male mental hospital patients give more diverse answers than 
do male college students. 
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One investigation of the above suggestion has been reported 
(4). Its method was to attempt to modify assumed integration 
by instructions to the subjects, college students, and to study 
its effect on diversity of answers to questions of the Bernreutcr 
Personality Inventory . The subjects were instructed to assume 
successively three different systems of beliefs, each system dif- 
fering in integration as evaluated by psychologists. The sub- 
jects answered the inventory questions three times, using the 
systems of beliefs as background for their answers. Each of 
these three times they used a different system of beliefs. The 
scores on the inventories reflected the systems of beliefs in the 
sense that those systems which were rated high on disintegra- 
tion by psychologists resulted in highly diverse answers, and 
those that were rated as much less disintegrated resulted in 
much less diverse answers. These results were accepted as 
some evidence that the factor under consideration is related to 
personality integration. 

The theoretical considerations together with the research 
findings justify more fundamental research designed to de- 
termine tfhe nature of the factor of diversity of answers and its 
relationship to personality integration. These more funda- 
mental researches are now in progress. They involve further 
applications of the criteria herein outlined for the selection of 
effective pairs of questions, together with factorial studies of 
pairs of questions for the same purpose, and in search of the 
nature and number of factors involved in the diversity of 
answers — to the end that effective tests of the factor or factors 
may be developed and studied in relation to their abilities to 
discriminate between groups such as mental hospital patients 
and community persons. Particularly significant in this con- 
nection is a study by Stanley Grzeda, toward his doctorate at 
the University of Illinois. He has requested psychologists to 
rate paired answers to questions according to the relative de- 
grees of personality integration reflected in them. Each psy- 
chologist was requested to use his individual definition of per- 
sonality integration. The paired questions from which the 
paired answers derive, are being factor analyzed, using the 
values assigned by the ratings of the paired answers, to de- 
termine the nature and number of factors involved. Grzeda 
is using questions identical with those of the above outlined 
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studies, and his results will be compared with the results from 
those studies. 

Tests will be developed from Grzeda’s results, provided the 
factorial studies justify such a procedure, and these will be 
applied in the studies of groups such as mental hospital patients 
and community patients. 
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CURRENT PRACTICES IN EVALUATION IN CITY 
SCHOOL SYSTEMS 


JOHN U. MICHAELIS 
University of California 

The purpose of this study is to review current practices in 
programs of evaluation in city school districts throughout the 
country, Attention is given to the direction of the programs, 
handbooks for teachers, evaluative devices used, testing pro- 
grams, cumulative records and critical problems currently con- 
fronting those in charge of evaluation. 

Data were collected by means of (i) an analysis of handbooks, 
cumulative records, and bulletins on evaluation as published 
by school systems; (a) a checklist on selected aspects ofevalua- 
tion; and (3) conferences with those in charge of evaluation in 
selected cities. One hundred school districts were invited to 
cooperate in the study; sixty-eight replied by completing the 
checklist sent to them and by forwarding pertinent published 
materials. 


Direction of the Program 

In reply to the question, “Do you employ a director of evalua- 
tion?” 5a school systems stated that they did; 16 that they did 
not. The various titles of those in charge of the program are 
shown in Table 1, the title “School Psychologist” being most 
frequently employed. 

Guide for 'Teachers 

Only one-fifth of the school systems reported that a guide or 
handbook on evaluation is provided for teacher use. These 
vary in size from three-page mimeographed bulletins to detailed 
printed booklets of over two hundred pages. Listed below is 
a composite selection of the items they cover which appear to 
be most helpful to teachers. These have been compiled from 

'S 
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TABLE I 

Title of the Individual Directing the Eoalttation Program in Fifty -Two City School 
Systems throughout the Country 


Title 


Cities 

Number Percent 


School Psychologist 

Director of Research . . 

Director of Educational Research . . 

Assistant Superintendent of Schools 

Director of Curriculum 

Director of Guidance , , , 

Assistant Director of Curriculum & Research. . . 

Director of Research & Guidance ... 

Director of Bureau of Child Study . . 

Director of Tests & Measurements. . . ... . . . 

Supervisor of Tests & Measurements 

Coordinator of Evaluation & Guidance 

Assistant Superintendent, Curriculum & Instruction 

County Supervisor . ... . . . . , . . 

Director ot Research & Curriculum .... . . . ... 

Supervisor, Department of Testing, Psychology, & Atypical Educa- 
tion . . ..... 

Coordinator in Department of Pupil Personnel (Group testing) . 

Director of Measurements, Statistics & Rcsenrch. 

Director, Department of Educational Investigation & Measurement . 

Director, Reference & Research . 

Divided among several departments. . 

Director of Pupil Personnel 

Supervisor of Special Education 

Coordinator of Guidance 6t Testing . , 

Director of Child Stud>^ & Service . . . ... 

Supervising Teacher, Director of Instruction 

Supervisor, Records Department 

Director, Department of Measurements & Standards 

Director of Testing 


6 1 1 
4 8 

3 6 

3 6 

3 t 

1 4 

* 4 

1 2 

I 2 

I 2 

I 2 

1 2 

1 2 

I 2 

I 2 

I 2 

t 2 

I 2 

I 2 

I 2 

I 

I 2 

\ 2 

1 2 

X 2 

I 2 

I 2 

r 2 


several of the handbooks; they do not reflect current practice in 
all school systems. 

Point of View 

Evaluation and educational purposes 
Evaluation as a process 
Purposes of evaluation 
Basic needs and differences of children 
Growth characteristics and evaluation 
Guiding principles of evaluation 
Characteristics of teachers who understand children 
Using Informal Devices 

Guides for observing behavior 

Anecdotal records 

Sociograms 

Group discussion 

Interviews 

Case studies 
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Case conferences 
Students in self-evaluation 
Checklists, rating scales, inventories 
Logs and diaries 
Files of sample materials 
Conferences with parents 
Samples of informal devices 
Recordings and stenographic reports 
Using tests 

Scope and schedule of the testing program 
Procedure for reviewing tests 
Guide to test administration 
Interpretation of tests — uses and abuses 
How to construct tests — sample items 
Relating test scores to achievement tables 
Bibliography of tests 
Organizing Information 
Using cumulative records 
Making case studies 
Making profiles 
Making reports to parents 
Special Problems 

Promotion and grade placement policies 
Adapting instruction to discovered needs 
Evaluation and curriculum planning 
Commonly used statistical terms and devices 
Bibliography on evaluation 


Evaluative Devices Being Used 

The many different kinds of evaluative devices currently 
being used are listed below in Table 1 , 


TABLE 2 

City School Systems Reporting the Use of Various Evaluative Devices 


Evaluation Device 


School Systems Using 
Number Per cent 


Tests 

Interviews 

Case studies. - . . . .... 

Case conferences, 

Observation 

Group discussion. 

Anecdotal records 

Questionnaires ........ 

Files of sample material. .... . . . 

Inventories . 

Rating scales, .. ..... ,. 

Checklists , 

Logs or diaries ........ , ....... 


68 

100 

5 4 

79 

54 

79 

47 

69 

47 

69 

46 

68 

35 

Si 

33 

49 

33 

49 

31 

46 

28 

41 

22 

3* 

8 

12 
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In addition to the devices listed above, individual school 
systems reported the use of: evaluative criteria, surveys, fol- 
low-up studies, statistical analyses, social case work, psychiatric 
devices, health records, parental conferences, staffs and clinics, 
sociometric techniques, pupils' graphs scores on achievement 
tests), recordings, films and photographs, stenographic reports, 
and profiles. 

Informal teacher-made tests are used in all systems. Inter- 
views and case studies are being used as evaluative devices in 
more than one-half of them. Logs, diaries, and checklists are 
used by one-third or fewer of the school systems. Although 
evaluation by means of observation is reported by only 69 per 
cent of the respondents in this study, it undoubtedly is used by 
most teachers as a practical method of appraising changes in 
child behavior. 


T ests Given in Various Grades 

The different types of tests, and the grades in which they are 
given, are shown below in Table 3. 


TABLE 3 

City School Systems Giving Various Tests with Grades in lohich Administered 


Typo of font 


Per cent giving teals in grades K through 12 


K 1 


iO 11 12 


Mental. , . . . 

Reading (including readiness tests) . . . 

General achievement 

Arithmetic 

Language arts 

Interests fit Social adjustment ........ 


12 43 IO 3 s 3$ 16 49 31 38 aa 32 192s 

12 44 29 3J 21 24 22 18 21 15 10 6 3 

4 12 29 34 28 51 26 29 15 12 12 9 

1 1 9 12 7 12 12 11 6 3 73 

1 4 3 4 4 4 IJ 

3 10 7 69 


Reading readiness and mental tests are given by approxi- 
mately the same percentage of the school systems in Kinder- 
garten, Grade I and Grade III. The use of mental tests tends 
to become somewhat higher in the advanced grades, reaching 
a peak in Grade VI. Achievement tests are not commonly 
used until Grade III, reach a peak in Grade VI, and decrease 
in frequency of use through the secondary-school grades, Tests 
in language arts other than reading are used in Grades IV 
through VIII by a very small percentage of the systems. Pref- 
erence, interest, personality, and social adjustment tests are 
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used by a few school systems in the secondary schools. Other 
tests of mental ability, personality, and special aptitudes are 
reported as being available upon special request in several 
school systems. 


Cumulative Records 

Cumulative records are used by 54 of the 68 cities reporting. 
An examination of these records shows that care is being taken 
to provide the teachers with child accounting forms that make 
readily available the results of the various devices used in 
evaluation. The most promising type of cumulative record is 
the folder, in which may be kept material pertaining to the 
pupil’s physical, educational, social, and emotional growth, 
The following summary indicates the topics that are included 
in the most complete forms: 

I, "Personal Information: Name, date, place, and evidence of 
birth; address and telephone number; race; nationality; 
sex; photograph 

1. Enrollment and Attendance: Date of enrollment; withdrawal 
and readmission; number of days of attendance; absence 
and tardiness; record of schools attended (with dates) 

3. Home and Community Information: Parents’ or guardians’ 

names; occupation, alive or deceased, birthplace, educa- 
tion, citizenship, marital status; number of siblings, rela- 
tives in home; language spoken in home; economic status; 
other information; church affiliation; home duties 

4. School Achievement and Curricular Experiences: Grades; 

reading record; deficiencies; record by subjects; achieve- 
ment test results; special interests; units in social studies; 
study habits; citizenship growth; other information 

5. Test Scores: Intelligence; achievement; aptitudes; per- 

sonality; other tests as given 

6. Health Information: Diseases; vaccination and immuniza- 

tion data; doctor’s and nurse’s examination and recom- 
mendations; operations; physical disabilities; mental 
health; adjustments in educational program; height and 
weight record; other information 

7. Special Interest Data: Hobbies; educational plans; voca- 

tional interests; co-curricular activities; work experience; 
other special interests 

8. Supplementary Material: Anecdotal records; case studies; 

counsellor’s or psychologist's notes; follow-up data; juve- 
nile court records; teacher’s comments; extra-curricular 
experiences 
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Current Problems 

The problems reported by directors as having arisen in con- 
nection with the evaluation program may be classified as those 
related to (i) selection of instruments, (a) interpretation of 
data and (3) administration of the program. 

1. Problems arising in connection with the selection of evalua- 
tive devices are: 

a) Guiding teachers in the selection of appropriate instru- 
ments for different purposes 

b) Finding tests to evaluate educational outcomes other 
than facts and knowledge 

c) Evaluating the effectiveness of instruments after selec- 
tion 

d) Guiding teachers in the use of sound criteria for selection 
of instruments 

e) Finding time for teachers to study critically instruments 
being considered for use 

f) Selecting tests which fit the curriculum 

g) Securing tests which are not dependent upon reading 
ability 

a. Problems arising in connection with the interpretation and 

use of data secured through the use of evaluative devices 

are: 

a) Minimizing the emphasis upon outcomes measured by 
achievement tests and increased emphasis upon more 
intangible outcomes that must be appraised by their 
evaluative devices 

b) Persuading secondary schools to use results of elementary 
testing programs 

c) Finding time for counseling on basis of data 

d) Using the diagnostic sections of tests 

e) Encouraging teachers to use data in daily teaching 

f) Interpreting the scores of various tests 

g) Interpreting data to pupils and parents 

h) Using data in curriculum improvement 

1) Using data to guide the selection of instructional mate- 
rials 

j) Using simple statistical terms and techniques in the in- 
terpretation of data 

k) Interpreting data in terms of the developmental levels 
of children 

l ) Encouraging teachers and principals (especially in high 
schools) to use cumulative records 

m) Using sound educational values in the interpretation of 
data as well as statistical analysis 
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3. Problems arising 111 connection with the organization and ad- 
ministration of the program are: 

a) Arranging records so that all teachers may use them 
without loss of time 

b) Securing efficient help for correcting and recording data 

c) Providing for the testing of pupils where there is a heavy 
turn-over of the school population 

d) Arranging a program that is well coordinated throughout 
the system 

e) Securing an adequate staff to assist in the program 

f) Constructing informal tests and devices to meet local 
needs 

g) Making follow-up studies to determine effectiveness of 
programs 

h) Fitting the progiam to the wide range of needs and abili- 
ties, especially in bilingual neighborhoods 

i) Organizing the program to serve the actual needs and 

? roblems of teachers and children 
mproving the utilization of cumulative records 
k) Securing adequate financial support for a complete pro- 
gram. 


Summary 

Programs of evaluation vary considerably in city school 
systems throughout the country. The direction of the pro- 
grams is most frequently placed in the hands of a school psy- 
chologist, yet 85 per cent of the systems use other titles for 
the person in charge. One-fifth of the school systems provide 
handbooks for teachers which vary greatly in size and design. 
A variety of appraisal devices are used with tests holding a domi- 
nant place in all systems ; mental, reading and general achieve- 
ment tests are most frequently employed. Cumulative records 
vary from simple cards to record grades received by the pupils 
to elaborate folders designed to record data related to the total 
development of the children; 80 per cent of the school systems 
provide them. The most critical current problems are related 
to the selection of instruments, interpretation of data, and ad- 
ministration of the program of evaluation. 

The greatest need for improvement lies in the area of evaluat- 
ing growth in democratic behavior. Inadequate appraisal is 
being made of such important factors as critical thinking, social 
adjustment, group processes, social attitudes and social under- 
standings. Instruments designed to measure social learnings 
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are rarely used except as various achievement tests contain 
sections on the social studies. An increased use of informal 
evaluative devices and the development of more effective instru- 
ments to measure changes in the foregoing factors should bring 
about considerable improvement in existing programs ofevalua- 
tion. 



THE PREDICTIVE EFFICIENCY OF THE 1946 
REVISION OF THE IOWA LEGAL 
APTITUDE TEST 

MICHAEL ADAMS 
Veterans Administration 

AND 

DEWEY B, STUIT 
State University of Iowa 

The experimental edition of the Iowa Legal Aptitude Lest 
and preliminary validation data were described in earlier articles 
in this journal (1, 2). Due to the fact that the United States 
was then at war and law school enrollments had dwindled to a 
very low figure, it was impossible to present anything like ade- 
quate validity data or to prepare useful norms. The present 
article is concerned with the 1946 revision of the Iowa Legal 
Aptitude Lest, particularly its effectiveness in prediction at 
several law schools. 

The following changes were made in the experimental edi- 
tion to produce the 1946 revision: 

Part I, Analogies, was reduced from 75 to 40 items and the 
time decreased from 45 to 20 minutes. 

Part 2, Reasoning, (formerly part 7) was left in its original 
form except for editing of some items. 

Part 3, Opposites, was reduced from 80 to 40 items and the 
time decreased from 35 to 20 minutes. 

Part 4, Relevancy, (formerly part 5) was reduced from 50 to 
40 items and the time decreased from 45 to 30 minutes. 

Part 5, Mixed Relations, (formerly part 2) was reduced from 
80 to 40 items and the time decreased from 35 to 20 minutes, 

Part 6 , Memory, (formerly part 4) was reduced from 30 to 
25 items but no change was made in the time allowed, 

Part 7, Information, (formerly part 8) was increased from 60 
to 80 items but the time was left unchanged. Several of the 
old items were edited and some replaced in the process of re- 
vision because they were found to be too easy. 

43 
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The Reading Comprehension section was deleted from the 
revision chiefly because of scoring difficulties. It was also 
believed that the functions measured in this part were ade- 
quately covered in other parts of the test 

The revision was completed too late in the fall of 1946 to 
have it administered at the beginning of the semester. As a 
result it was possible to administer the test at only three law 
schools. The students, at the time they took the test, had 
completed nearly one semester or one to two quarters of law 
school work. Four additional schools gave the test to all of 

TABLE 1 


Performance of First Year Students in Different* Colleges of Law on the 7946 
Revision of the Iowa Legal Aptitude Test 



N 

M 

V 

Range 

College A 

109 

170.62 

30.50 

107-^42 

College B 





Class I 

176 

168.10 

3° -3° 

80-258 

Class II 

38 

169.76 

34 -io 

102-230 

Class III 

95 

163 34 

29.70 

84-241 

Class IV 

40 

167 00 

2b. 60 

1 14-225 

College C 

I^O 

166. 15 

28.24 

98-232 

Class I 

33 

174.70 

37-3° 

9 >-243 

Class II 

82 

179.51 

34 61 

U 7-240 

College E 





Group I 

97 

157.80 

34 -ia 

85-235 

Group II 

7 1 

163.65 

36.00 

75-335 

College F 

207 

178.82 

31.30 

IOO-250 


* Colleges of Law at the following institutions were included: State University of 
Iowa, University of Washington, University of Pittsburgh, University of Colorado, 
Loyola University, Temple University. 


their new students during the academic year 1947—48. The 
present norms for the test are based upon the performance of 
the beginning students in six of these seven schools. 

The number of cases, mean and standard deviation at each 
school using the test, are presented in Table 1. Since the 
differences among the schools are not extremely great, it was 
deemed permissible to combine the results into a single norma- 
tive population. 

The intercorrelations between the unweighted raw scores on 
the seven sub-tests comprising the total test battery and the 
correlations between the raw scores on each sub-test and the 
total raw score on the battery, based upon the performance of 
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176 students at School B, are presented in Table 1. The 
highest mtercorrelations are between Analogies and Opposites, 
Analogies and Mixed Relations, and Opposites and Mixed Re- 
lations. These three tests, Analogies, Opposites and Mixed 
Relations also show the highest correlations with the total 
scores. The latter correlations are all spuriously high, of 
course, because each part score is contained in the total. 

TABLE a 

Inter correlations oj the Total and Sub-Test Unweighted Raw Scores on the 194.6 
Reotston oj the Iowa Legal Aptitude Test 



TABLE 3 

Correlations Between Measuies of First Year Law School Achievement and Scores in 
the 1946 Revtston of the Iowa Legal Aptitude Test 


College of Lav/ 

H 

r 

AT- 

0* 

College B 

Class I 

176 

■S 3 

168, 10 

30 - 3 ° 

Class II 

38 

■ 57 

169 .76 

34.10 

Class III 

9 S 

• 43 

163-34 

29.70 

Class IV 

40 

46 

167.00 

a6 60 

College C 

Id© 

•44 

166.15 

48.014 

College D 

Class I 

33 

.63 

174.70 

37 - 3 ° 

Class II 

81 

49 

179.51 

34.61 

College F 

206 

.5* 

178.8a 

3 1 '30 


* These statistics based on total scores in the aptitude test. 


Studies of the predictive value of the test have been made at 
several institutions. The results are presented in Table 3. 
In general, these correlations are slightly lower than those which 
were obtained with the longer experimental edition. 

A multiple correlation coefficient, using the part scores in 
the test as predictive indices, was computed for School B, Class 
I. The Wherry-Doolittle Method of computation was used 
and a combination of parts i, 4 and 7 was found to give the 
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best prediction of the criterion, Ra.m = .59. A simple un- 
weighted sum of parts 2, 4 and 7 correlated .60 with the cri- 
terion. The multiple regression equation is as follows: 

Z 0 = 3108 Zi. + .0.661 z * + • 17^ 2 ? 

In terms of raw scores the equation is: 

Xo = .3347 *2 + .4934 -Vi + 1755 1V7 + 43.23 

After it had been found at School B (Class I) that a combina- 
tion of tests 2, 4 and 7 gave the best prediction of the criterion, 
the correlation coefficient between the sum of the scores in 
parts 2, 4 and 7 and the criterion for School F was computed. 


TABLE 4 

Correlations Between Undergraduate Grade Point Averages and Scholastic Success in 

First Year Law 


Law School 

N 

r 

School B. Class I 
"Own” Students 

106 

•44 

“Transfer” Students 

70 

.41 

Total Group 

176 

.42 

School C 

115 

•55 

School F 

I06 

■41 


This coefficient was .56. At both Schools B and F, therefore, 
a combination of parts 2, 4 and7 gave as good a prediction of the 
criterion as did the total score in the test. As a result of this 
finding separate norms have been provided for the sum of 
scores in parts 2, 4 and 7 The answer sheet for the short 
form as well as the total test must be scored with a stencil (3). 

One of the more significant questions about a professional 
college aptitude test is whether it predicts success more effi- 
ciently than does the average of undergraduate work previously 
undertaken. These correlations were computed for three insti- 
tutions. The results are presented in Table 4, In Schools B 
and F the aptitude test was somewhat more efficient as a pre- 
dictive index than the undergraduate grade-point average; in 
School C the situation was reversed with the undergraduate 
grade-point average correlating more highly with the criterion 
than did the aptitude test. 

Success in first-year Law as measured by grade-point average 
constituted the criterion in all of the validity studies conducted. 
No information was available as to the reliability of the qr\- 
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terion or its adequacy as a measure of success. Since the grade- 
point average was the only evaluation of success in the study 
of law which was available, it was accepted for use in this study. 

One of the most interesting findings was obtained with Class 
III at School B, In this instance the test was given during 
the first few days of the semester before any of the students 
had withdrawn. During the course of the first semester, six- 
teen of the students decided for various reasons to discontinue 
their law course. The average raw score of these sixteen 
students was 125 which has a percentile equivalent of six. It 
is also of interest to note that very few students with scores 
below 130 have succeeded in making an average grade at any 
of the law schools using the test. 

In conclusion it can probably be stated that the Iowa Legal 
Aptitude T est is a fairly good predictor of success in typical law 
schools. The word “typical” is used because no law colleges 
with stringent admissions requirements were included in the 
study. All required two to three years of undergraduate work 
for admission and many of the first-year students included in 
this study were college graduates. However, none required a 
particular score in the aptitude test as an admissions require- 
ment. While the test is probably not a great deal better “on 
the average” than the undergraduate grade-point average for 
predicting success in law school, it should prove especially help- 
ful in the counseling of individuals concerning whose under- 
graduate work there is some question. Like other scholastic 
aptitude tests it should provide a uniform measuring stick for 
the appraisal of the counselee's potentialities in a particular area 
of study, in this instance, Law. 
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STATUS ANXIETY AND OCCUPATIONAL CHOICE 

MAX M LEVIN 
State College of Washington 

To date there has been a greater emphasis upon the de- 
termination and measurement of occupational interests than 
upon systematic considerations and studies dealing with the 
genesis of such interest patterns. While the exigency of 
matching men and jobs has rendered the former preoccupation 
of basic importance, the new trends in occupational counseling, 
viewing as they do effective counseling to be a process imbedded 
in a broader context of personal and social counseling, necessi- 
tate not only the determination of interests but also an under- 
standing of the dynamics of interests and their significance in 
the case of a particular client. A full appreciation of the 
motivating factors leading to the development of a given in- 
terest profile would doubtless require the specification of in- 
numerable aspects of the life history of the individual. Subtle 
and basic personality characteristics, models which served as 
identification figures, casual and persistent experiences which 
satisfied achievement and other needs, or frustrated them, 
would be among the many factors to be found significant. 
Carter (i) has studied some of the developmental aspects of the 
problem, while Bordin (a) has emphasized the individual’s 
stereotyping of himself and of occupations as a dynamic basis 
of occupational interests. But in addition to these personal 
and idiosyncratic determiners, and underlying the stereotyping 
processes emphasized by Bordin, social and cultural pressures 
are of significance. Some aspects of these shall be considered 
in the present paper. 

The necessity for the widespread vocational services, both 
public and private, attests to the basic significance of job ad- 
justment for the social and personal welfare of the individual 
in our society. The increased utilization and expansion of such 
services reflects not only the growing awareness of the value 
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of such guidance and counseling but also the increasing concern 
with occupational achievement. That is to say, there appears 
to be in our present-day society increasing ego-involvement 
with respect to occupations for a larger proportion of our popu- 
lation than has been true previously. The fact that such large 
numbers of individuals — for example, the veterans — would 
postpone the gratification of their present biological and social 
needs to seek extensive and time-consuming vocational and 
educational training in order to achieve more highly valued oc- 
cupational goals, would indicate that this represents a sig- 
nificant social trend. An important, although perhaps partial, 
explanation of this development can be derived if the functional 
significance of occupational achievement is related to some 
characteristics of our society. 

The analyses and theories of such contemporary anthro- 
pologists and sociologists as Dollard (3), Linton (4), and Warner 
(5) have indicated that our culture is stratified in terms of classes 
and, with respect to some members of our population, stratified 
with respect to caste as well. Despite the pious democratic 
aspirations of our culture, their research, as well as that of 
many other investigators, has shown that definite statuses and 
roles are conferred upon individuals in part by virtue of their 
class membership. They have also shown that there is a certain 
degree of mobility present in our class structure, so that some 
individuals find it possible, and others necessary, to move from 
one class to another. It is clear that occupations would be 
of considerable significance in the establishment of class mem- 
bership as a consequence of some intrinsic characteristics of 
certain occupations such as type and extent of power and in- 
fluence, nature of associates and affiliations, etc. The status- 
conferring aspect of occupations is not exclusively dependent 
upon the income level inasmuch as our hierarchical class struc- 
ture is only partially related to economic factors. Centers (6) 
has shown that common attitudes and beliefs are more sig- 
nificant criteria for class identification than purely economic 
factors. In terms, therefore, of the relationships between given 
occupations and their common class status, certain attitudinal 
and belief requirements may be expected to be associated with 
the various occupations. It would not even be rash to assume 
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that many of the emotional and personality requirements of 
various occupations are fundamentally based on class status 
factors and not on job requirements, as such. Thus, the pro- 
fessional is expected to appear, behave, feel and think quite 
differently than the skilled worker, and even more differently 
than the semi-skilled worker or unskilled worker. The stereo- 
typed hierarchical classification of vocations is essentially a re- 
flection of their class-conferring characters. 

In a relatively mobile class society in which the vocations 
have class-conferring potency, it is obvious that ego-involve- 
ment with respect to occupational achievement would be high 
for many. Occupations must be selected, consciously or other- 
wise, in terms of their value in either maintaining the present 
class membership, if that is adequate to the individual's level of 
class aspiration, or in terms of their value in facilitating the 
individual’s climb to the class considered higher, if he is mo- 
tivated to do so. The problems connected with maintaining 
class status or of climbing higher have been seen by Davis (7) 
to engender what he refers to as “socialized anxiety" and is 
essentially what we are referring to as status anxiety. This 
anxiety is seen by Davis to account for a substantial source of 
motivation leading to the establishment of life goals, the post- 
ponement of gratification of social and biological needs to 
achieve the valued goals, the very preoccupation with achieve- 
ment, and many other aspects of socialized behavior observed 
in our culture. 

Perhaps it might be well to illustrate briefly the operation of 
such anxiety with a specific case. 

The client, a veteran 11 years of age, of high average intelli- 
gence, with superior mechanical aptitude, decides upon dis- 
charge from service to enter college. Prior to enlistment he 
had no clearly formulated vocational goals and evidenced little 
academic interest throughout his school career. In the service 
as an enlisted man, he began to recognize that to “amount to 
something, you had to have a college education." His father, 
a carpenter, had occasionally mentioned his regretting having 
left school after the completion of the eighth grade. The 
father suffered from the contrast with a college-trained brother- 
in-law who became a successful manufacturer, and on whom he 
was financially dependent during the depression years. The 
mother, the client felt, was never satisfied with the family’s 
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socio-economic situation The client, too, felt that during 
adolescence his own family “did not amount to much.” He 
admired his successful uncle and could not understand why his 
father, after so many years of work, was not in a position to 
own a comfortable home and to purchase a new car. He felt, 
moreover, that the family’s social circle was limited and not 
nearly as respectable as that of his uncle. During the first 
counseling sessions the client expressed concern about his apti- 
tude for college work and having the “personality” for profes- 
sional work. Yet, he felt that if he did not complete his college 
education, he would probably have to become a “ditch-digger.” 

The counseling included, in part, a growing awareness on 
the part of the client of his status anxiety as a source of motiva- 
tion for his college training and occupational goals. This in- 
sight, along with others no doubt, in this particular case, was 
accompanied by an increased acceptance of the possibility of 
not completing college and adjusting himself vocationally on 
a non-professional level, that is to say a level having lower class 
status. To be sure the same case could be rationalized on 
other levels in terms of mother identification, hostility toward 
the father, and perhaps in terms of other dynamic formulations. 
Regardless of the level of interpretation, however, the status 
factors will need to be considered The hostility towards the 
father functioned in a context of status anxiety, We need not 
at this stage of theorizing concern ourselves with the issue of 
establishing the precise casual sequence; that is, did the status 
anxiety substantially contribute to the father-directed hostility 
or was it, in turn, generated by the attitudes toward and the 
relationship with the father? Such problems concerning the 
interrelationships of intra-family attitudes and feelings and 
similarities or dissimilarities in status aspirations need to be 
clarified by further research. 

To appreciate the role of status anxiety in the life adjustment 
of the individual in our society we need to specify in greater 
detail its operation and consequences, not only with respect to 
occupational choice but to the conflicts and adjustments issuing 
from occupational choice as well. We might view the indi- 
vidual’s achievement of his occupational goals as a process pre- 
ceded by the overcoming of many and, in some cases at least, 
difficult barriers Such barriers may stem from intrapersonal 
characteristics: aptitudes, personality, physical and physio- 
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logical factors, etc. Additionally, there may be imposed 
social and cultural barriers as well. Admission to colleges, ful- 
filling the requirements, securing the grades, entrance to the 
crowded professional schools, internship training programs, 
passing the state examinations or being licensed and certified 
in some other manner, getting the appointment, or establishing 
a private practice, are merely some of these many barriers. 
The mere enumeration of these hardly depicts the actual stress 
and tension engendered in the individual confronted with the 
painful process of overcoming the many obstacles. (Consider 
further the additional barriers confronting a member of a racial, 
national or religious minority.) 

The process of overcoming the many barriers alone are 
enough to eventuate in tension, fear and anxiety in some in- 
dividuals, and at least in some degree of apprehension, self- 
doubt, and feelings of inadequacy in others. Moreover, when 
the major determiner of occupational choice is status anxiety, 
as well it may be in the case of many people, other sources of 
conflict can be conceived. Occupational goals may be selected 
which are uncongenial to basic interests, fundamental aptitudes, 
and even the essential personality structure. A boy with high 
mechanical interests and aptitude, and limited college aptitude, 
insists on becoming an engineer. A girl ideally suited for cleri- 
cal work insists on entering the field of interior decorating. 
Every counselor can unquestionably compile his own list of 
examples. All too often, however, the basis for the discrepancy 
is explained away as a result of misinformation, immaturity, or 
misguidance by the parent. These may all be factors but they 
become effective in such cases precisely because the individual 
is susceptible to selecting inappropriate objectives by virtue 
of his status anxiety. Were he not motivated by his quest for 
social-class status he would be less apt to be talked into a 
choice uncongenial to his basic characteristics. And perhaps 
even the misinformation that may exist is of a motivated va- 
riety. 

The conflicts and maladjustments may persist even beyond 
the preparatory occupational period and remain with the in- 
dividual during the course of his work history leading to fre- 
quent job changes, poor work morale and job dissatisfaction. 
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They may persist as a consequence of shifts in the individual’s 
status aspirations. Having achieved a previously established 
class-status goal, hemay feel that he must not rest on his laurels; 
he must show that he is still ambitious. Encouraged by his 
success, he sets as his goal the next rung in the status hierarchy 
and once more becomes involved in the battle, He may be 
stimulated, urged or even compelled to do so by members of 
the family, e.g,, a social-climbing wife, if not by his own achieve- 
ment needs. The status-conferring potency of the occupation 
may change. A position which might once have been a guaran- 
teed ticket to middle-class respectability no longer yields such 
high returns. The position of the pharmacist in the apothecary 
becomes largely retail clerking in the urban department drug 
store and may in the process have declined in status-value. 
The individual is confronted with the choice of reconciling him- 
self with lesser status or changing his vocation. Social and 
cultural exigencies such as a war may thrust individuals into 
positions of unusually high status, only to have to suffer with 
the return of pre-war conditions the let-down of returning to 
the lower-status positions previously held. The prevalence of 
the latter in recent years has been painfully obvious to many. 
Yet even in this instance, the status aspect has not been recog- 
nized nearly as much as the shifts in income, in power and 
authority, and in other more tangible aspects. 

As a consequence of the painful strivings to achieve or per- 
petuate status by means of occupational choice and achieve- 
ment, the anxiety generated in the process may be conceived 
to have widespread effects on the personality structure of those 
who are especially vulnerable. When the status anxiety and 
the conflicts and adjustments stemming from it are added to 
the more idiosyncratic conflicts and adjustments, neurotic solu- 
tions may readily result. It is for this reason that it is often 
difficult for the occupational counselor to diagnose the extent 
of the maladjustment and determine the type of therapy that 
is actually needed by the client. Similarly, it is not incon- 
ceivable that some patients of the psychotherapist could find 
substantial relief more readily by working through and resolv- 
ing occupational problems than conflicts and adjustments in 
Other areas, 
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It is not to be inferred that status anxiety need be considered 
universal even in our society. Some individuals, to avoid 
strivings, conflicts, and anxiety, may lower their class-aspiration 
level. The college professor’s son may repress his status anxi- 
ety, renunciate his family’s class and settle for a worker’s 
status. (To some extent this is often encouraged, providing 
the individual will continue along the road of regaining class 
status on his own, rather than resting on the class laurels of 
his family. The son of the corporation’s president may start 
at the bottom and work his way up, presumably proving to 
himself and others that he was able to achieve his own status.) 
Many in the so-called lower classes do not appear to be afflicted, 
or even motivated by status anxiety. Teachers will attest, 
although not always understand, that many pupils of lower 
class status seem to lack any genuine motivation to learn, to 
accomplish, to “make somebody of themselves.” The very 
fact that their status is so low has resulted either in their posi- 
tive acceptance of their lot, or in negatively giving up all hope 
of being able to achieve higher status. Frequently their own 
socio-cultural environment provides no stimulation for the de- 
velopment of higher-class aspirations. Status anxiety may also 
be absent in the small group at the very top of our class struc- 
ture. These individuals by virtue of their family’s heritage are 
so secure in their class status that no anxiety on this score need 
develop. In this group, one frequently finds the proverbial 
playboy. Having no status anxiety, a strong motivational 
basis for achievement simply does not develop; the individual 
confidently expects to maintain his high-status level by having 
chosen the proper family in which to be born Yet, the ab- 
sence of status anxiety in any class is often considered, per se, 
as a pathognomic sign of maladjustment. While in some it 
may reflect disturbance of the personality, in others it need be 
little more than the consequence of their social and class 
milieu. The diagnostic sign of the client’s utilization of his 
capacities must consequently be evaluated in terms of the fac- 
tor of status anxiety. Having restricted achievement needs 
and low motivation educationally and vocationally may have 
quite different diagnostic implications in different social classes. 



EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT 


Implications for the counseling process 

The recognition of status anxiety as a potential determinant 
of occupational choice should lead to a fuller understanding and 
appreciation of the ego-involvement with occupational achieve- 
ment so widespread in our culture. It will clarify in part the 
painful strivings of some clients, the indecision of others, and 
the difficulty evidenced in some cases to arrive at an occupa- 
tional choice commensurate with and appropriate to their basic 
personal characteristics Beyond this, however, it may even 
have some implications for the methodological problems of the 
counseling process as such. The recognition of status anxiety 
as one of the primary motivational factors in the case of many 
clients would argue for more penetrating counseling techniques 
than are now usually employed. Tomkins (8), in describing 
the applicability of the thematic Apperception 'Test in vocational 
guidance asserts, “Assessment of an individual’s needs in the 
work region differs in no essential manner from any other 
variety of personality diagnosis. It is as simple or as complex 
as a determination of the conditions of a neurosis and of no less 
urgent import to the individual.” The facts of status anxiety 
and other personality needs as they bear on the occupation 
choice dilemma for the client require, in the case of some 
clients at least, depth approaches in vocational counseling 
rather than the superficial approaches which concentrate on the 
determination of fragmentary and specific skills and aptitudes 
and the routine imparting of occupational information. Such 
preoccupations are often quite meaningless to the client and 
are trusted even less because they do not relate the vocational 
problem to his basic needs which he, if not the counselor, senses, 
albeit dimly. It is only when the basic motivations such as 
status anxiety and intra-personal needs are structured and clari- 
fied that the client can utilize meaningfully the psychometric 
results and occupational information. 
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THE MEANING OF “VALIDITY” AND “RELIABILITY” 
AS APPLIED TO SOCIOMETRIC TESTS 1 


PAULINE NICHOLS PEPINSKY 
Pullman, Washington 

It is the purpose of this paper to attempt a clarification of 
the meaning of the terms “validity” and “reliability,” as they 
may be applied appropriately in an evaluation of sociometric 
tests. These instruments are being employed increasingly in 
educational and psychological research, having been in wide 
use by sociologists for a number of years. It is their intention 
to focus on an analysis of the individual as a member of a group, 
rather than on the individual as an entity in isolation. 

It seems pertinent, in view of the unique possibilities which 
sociometry affords through its use as a tool of psychological 
research, to try to define as clearly as possible its nature in 
relation to the methods more familiar to psychological workers. 
A psychometric orientation to the use of paper-and-pencil tests 
implies a frame of reference in their evaluation which is not 
immediately applicable to sociometry. 

The Concept of “ Validity” 

An operational definition of a psychological test would in- 
volve a statement to the effect that it is one in which an in- 
dividual responds to a number of items, these responses being 
taken to be indirect evidence of the possession by that indi- 
vidual of certain characteristics to a certain degree. A socio- 
metric test, on the other hand, requires the selection by each 
individual in a specified group of one or more other individuals 
in that group on the basis of stipulated criteria of choice. Ex- 
pressed simply, in the former case, the individual “reports on” 
himself; in the latter, he “reports on” and is “reported on” by 
others. 


‘The writer wishes to thank Harold B, Pepinsky and John B, Holland for their 
careful reading of this paper and for their constructive criticism. 
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In the first instance, interpretation of an individual’s quanti- 
tative score usually is made by reference to established norms. 
In the second, the individual’s "score” is the number of choices 
he receives from other members of the group, or the number 
he gives to them, and interpretation is limited to a statement 
of his “status” (in the case of choices given) in terms of that 
choice number only and for that group only. As Jennings (3, 
p. 27) has said of the sociometric test, “it does not attempt to 
measure behavior of a certain type by eliciting related responses, 
but employs a sample of the actual behavior studied” (italics 
mine). In other words, choice behavior is being studied, and 
choice behavior is what is elicited by the test. 

Information concerning underlying motives or traits is not 
furnished by the application of sociometry alone. Although 
inferences about motives and traits may be plausibly suggested 
by sociometric data, these are hypotheses to be tested by other 
means. A word of caution, both to sociometrists and psychom- 
etrists, refers to generalization from sociometric data, i.e., from 
one kind of choice behavior, to a broad inference about in- 
dividual personal or social adjustment. Unless social adjust- 
ment is carefully and narrowly defined in terms of the particular 
behavior sampled, or unless the diagnosis of “adjustment” is 
supported by other congruent data, such statements are un- 
warranted One example of such loose interpretation has been 
cited elsewhere (5) in criticizing a study by Zeleny (10) in which 
he uses such words as “happy,” “pleasant,” and “frustration” 
in a discussion of an individual’s sociometric test scores. These 
feeling-states can only be indirectly inferred from his socio- 
metric data and must be validated against other criteria. It 
would be just as questionable to imply that an “extrovert,” 
psychometrically tested, is a “leader” in his group, without 
supporting data on his actual choice relationships in the group. 
The sociometric tool is only one method, then, to be used most 
fruitfully in conjunction with others, as a supplement to, rather 
than as a substitute for, psychological tests. 

This brings us to the question of how the concept of "valid- 
ity” may be applied to sociometric instruments. Since, as 
stated above, these do not record behavior assumed to be in- 
directly, and to some degree, indicative of the possession of 
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certain attributes, but afford instead a direct sample of the 
behavior under study, reference to an “outside” criterion has 
no meaning in the usual sense 

But, as Jennings has also noted, it does have a particular 
relevance: “It may be considered, however, whether a socio- 
metric test is valid in the sense that the behavior which it was 
intended to elicit actually appeared without falsification on the 
part of the subjects” (3, p. 27), The solution to this problem 
might be given by an evaluation of the rapport of the experi- 
menter with the subjects, by observation of group behavior in 
situations illustrating the choice criteria presented, and by evi- 
dence from other case data of the individual’s acceptance or 
rejection by the group. Quantification of such material might 
be achieved through analyses of independent ratings by trained 
observers or judges. 

In this connection the contention of Moreno and others may 
be pointed out that the test should be “a motive, an incentive, 
a purpose, primarily for the subject, instead of for the tester” 
(7, pp. 14, 15) The implication is that the relationships tested 
are most honestly revealed when the results of the testing will 
“make a difference” to the subjects “when the results of the 
test are or can be put into immediate operation” (2, p. 77). 

To summarize briefly, validity — “the extent to which a test 
measures that which it purports to measure” — is intrinsic to 
sociometric data, since test results are choice behavior, and the 
test purports to measure that choice behavior. But generaliza- 
tion beyond the specific behavior sampled does necessitate 
reference to outside criteria or supportive data, In order to 
meet the remaining questions of whether subjects’ stated 
choices may be accepted as “valid” in the sense that they are 
subjectively honest, this testing situation, like those in psy- 
chometric testing, should be set up in such ways as to maximize 
the rapport with the experimenter and the motivation for the 
subjects. The hypothesis has been cited that motivation of 
subjects in sociometric testing increases as the criteria of choice 
have meaning to the subjects and as this meaning includes the 
knowledge that changes will be made in the group structure on 
the basis of the choices which they express as individuals. 
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The Concept of “ Reliability'’ 

In attempting to derive a clearer concept of “reliability” as 
it may properly be applied to sociometric tests, it may be help- 
ful, first, to pursue further our comparison of psychometric and 
sociometric instruments. The earlier discussion emphasized 
the difference between an approach which measures (a) be- 
havior somehow and to some degree related to certain aptitudes, 
interests, abilities, or traits, and (b) behavior directly repre- 
sentative of the behavior pattern under study. It now seems 
pertinent to try to delineate some characteristics of these tests 
which have a close relationship to the methods by which we 
may obtain measures of their relative “reliability” and to the 
interpretations which may be given to such measures. 

One of these factors is that of the stability of the behavior 
being measured. We may consider, for example, the relatively 
greater stability of the behavior which an “intelligence” test 
attempts to measure indirectly, over that which a sociometric 
test attempts to measure directly. The “constancy of the IQ” 
would seem to be a much more tenable hypothesis than the 
“constancy of choice of classroom seatmates”! There seems 
to be considerable evidence to support the hypothesis that the 
more a kind of behavior becomes involved by definition in social 
experiences, and the more complex is its relationship to “in- 
nately” determined attributes, the greater the apparent fluctua- 
tions that may be expected. Hence, such fluctuations over an 
extended period of time might legitimately be expected in so- 
ciometric data, these variations quite possibly reflecting actual 
changes in behavior, rather than low reliability of the instru- 
ments themselves. 

We are led next to the closer analogy of the problems involved 
in the measurement of the reliability of psychometric "per- 
sonality” tests. It is not surprising that “coefficients of relia- 
bility” of standardized personality tests have generally been 
much lower than those of "intelligence” tests. And the theory 
has been advanced that a concept of “clinical reliability” may 
be plausible in which it is held that fluctuations occurring in 
measured behavior may be entirely consistent with those found 
in clinically defined syndromes (6, pp. 161-162), In such an 
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instance it would be conceivable that a coefficient of reliability 
might actually be too high, to the extent that the test-item 
responses implied greater rigidity than that present in the 
actual behavior. 

It should also be noted that, unlike responses to paper-and- 
pencil tests either of “intelligence” or “personality,” socio- 
metric tests do not consist of an individual’s report on himself 
on N items, but consist, rather, of his reporting on N-i other 
persons, or of N-i other persons’ reporting on him, on each 
item, or criterion, of choice. This statement suggests a simi- 
larity between the method of sociometry and that of the rating 
scale. 

Among the instruments most familiar to the psychologist, it 
may seem, then, that the rating scale is most nearly analagous 
to the sociometric test. But there are still important basic 
distinctions. Most obvious are the differences that sociometric 
“ratings” are made by the individual’s peers, who are not 
“qualified judges” in the usual sense, and that “ratings” are 
made by N-i “judges,” and not by one, two, or three “experts,” 
as is the common practice. 

For purposes of comparison, let us employ as examples of 
materials or situations to which rating scales are often applied 
(a) job performance, (b) controlled problem situations, and (c) 
case data. In all three instances the attempt is made to con- 
trol experimentally the choice or rating criteria and the behavior 
material rated, i.e., performance on a specific job, observation 
of reaction to a specific problem situation, specific types of case 
data, while the judges vary in their ratings. With sociometry, 
however, only the criterion of choice is held constant, while the 
behavior material (i,e., the interpersonal relationship), on the 
basis of which a rating or choice is given, varies with each judge, 
and the judges are expected to vary in their ratings. 

A further distinction between the rating scale and the socio- 
metric test should be stressed. In the former case raters usu- 
ally are asked to make judgments about the degree to which 
subjects possess certain traits or personality characteristics un- 
derlying or related to their behavior in the observed situations. 
In the latter, subjects are asked only to make choices of in- 
dividuals, to state preferences for them with reference to a 
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specified criterion (or criteria) of choice. It is the goal of the 
experimenter who employes a rating scale to obtain close agree- 
ment among judges, while the goal of the experimenter who 
uses a sociometric test is to obtain a reflection of the actual 
choice behavior of individual group members, in which con- 
sensus may, or may not, be present. 

If we take all of these unique aspects of sociometry into ac- 
count in selecting a measure which will give a meaningful in- 
dication of the reliability of a particular test, we begin to 
understand that a simple transfer of method and interpretation 
is not appropriate. This is not to imply, of course, that the 
problem of computing and evaluating “reliability” measures of 
psychometric tests is assumed to have been satisfactorily solved. 
Although an analysis of this situation is outside the immediate 
province of the present discussion, it does seem in order, to 
stress the fact that real confusion and ambiguity do exist with 
respect to the too often uncritically accepted “reliability co- 
efficient.” Such investigators as Loevinger and Goodenough 
have treated this problem elsewhere (i, 4). 

When the “reliability” of sociometric tests has been reported 
in research, it has been on the basis of a “test-retest” correla- 
tion. But the nature of the groups and situations in which 
sociometry is employed makes this method seem often of dubious 
value. For example, the purpose of some studies is to deter- 
mine the extent of “cleavage” or of “cohesiveness” in groups 
that have been associated for a period of several months. If 
this testing were to be undertaken in classroom groups of some 
, schools, it would have to be done at or near the close of a school 
term, the longest period for which group membership remains 
unchanged. Retesting, if it were to involve the same groups, 
could not follow in an interval of more than a few weeks, which 
time lapse would not be sufficient to eliminate the very probable 
large influence of the memory factor in the second administra- 
tion. If, on the other hand, it is possible to readminister the 
tests after a lapse of, say, six months or more, the previously 
stated question of the stability of the behavior measured arises 
to complicate the interpretation of the obtained coefficient of 
correlation. The coefficient might be expected to vary for dif- 
ferent age levels and for different groups, so that a low correla- 
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tion might not be a function of the instrument, but of the in- 
stability of the relationships on the basis of which choices are 
made, or of the particular group structure. The correlation 
would seem to reflect, rather, the degree of change in choice 
behavior in a particular group after a specified lapse of time. 
As was mentioned earlier, obtaining a “high” test-retest corre- 
lation may not, on the other hand, be a “desirable” result, 
since this may be an indication that the test is not accurately 
reflecting the shifts in the dynamics of group relations which 
have actually taken place. 

The test-retest correlations reported in published studies do, 
in spite of the stated conditions which might lead one to expect 
other results, tend to be high. Several studies, all of which 
had lapses of only one to four days between the first and the 
second testing, obtained correlations varying from .93 to .96 
(8, p* 35 ) 9 > P- 804, 3, p. 31). The memory factor may well 
be a very “reliable” trait itself, when measured over such a 
short period! 

When Jennings computed test-retest correlations of “choices 
for the subject” and “rejections for the subject” at intervals 
eight months apart, she found lower correlations of .65 and 
.66, which would indicate, she says, “some agreement (some 
consensus) from one time to a later time” (3, p. 57). 

The conclusion to which we come is not that some kind of 
test-retest measure would not be useful and meaningful, but 
that its purpose and interpretation should be carefully defined 
and understood. The statistical techniques employed should, 
moreover, be selected or devised to answer the needs of a par- 
ticular experimental design and of particular sociometric data. 
Such factors as the number of criteria involved in choices, the 
number of choices which an individual is permitted to make, 
the number and kinds of test-retest situations involved, and 
the type of sociometric approach used, all should be taken into 
account in setting up methodology for analyzing the stability 
of the choice behavior measured in a certain study. These and 
other qualifying conditions make inappropriate any rule of 
thumb technique for universal application. 

But there are important questions to be answered, questions 
which do lend themselves to statistical analysis. They have 
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to do with determining the stability, or “consistency,” or “re- 
liability,” of choice behavior itself over varying intervals of 
time for different age and grade levels and for different group 
structures. We might ask (1) whether the status (choices re- 
ceived) of individual members of a group varies significantly 
over a specified lapse of time; (a) whether the expansiveness 
(choices given) of individual members of a group varies sig- 
nificantly over a certain period of time; (3) whether in these 
instances status is more stable than expansiveness; (4) whether 
choice behavior increases in stability with age; (5) whether 
choice behavior based on any one criterion may be more stable 
than that based on another; (6) whether the introduction of 
certain planned leadership techniques or group procedures may 
induce changes in choice behavior. If we accept sociometry 
as a direct measure of the behavior under study, then the 
relevant problem of “reliability” is one of determining the 
stability of that behavior, rather than that of investigating the 
reliability of the test. With this kind of instrument it is not 
possible to speak of test reliability independent of the influence 
of the stability of the choice behavior itself. 

We have spoken of “test-retest” reliability in the context of 
sociometric analysis. Suppose that we are interested in the 
problem of “internal consistency” of a sociometric test. Does 
this concept have meaning for sociometry and, if so, what would 
be an appropriate interpretation? Conventionally, a “split- 
half reliability coefficient” has been used to estimate the “in- 
ternal consistency” of psychological tests, an acknowledgment 
not intended to bely the confusion really implicit in the use and 
calculation of such a coefficient. As Loevinger has commented, 
“there are as many split-half correlation coefficients as there 
are ways of dividing the test in two” (4, p. 6). One of the 
assumptions underlying these coefficients is that halves of the 
test correlated are “equivalent,” or “random,” halves. And 
a legitimate question has been raised as to the justification one 
may have for assuming that the halves constitute “equivalent” 
samples of responses to the test as a whole or “equally good” 
measures of the criterion. 

If the attempt is made to transplant this sort of technique to 
an analysis of sociometric instruments, one of the difficulties 
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faced at once is that of deciding how it may logically be held 
that choices given or received by an arbitrarily selected half 
of a group are "equivalent” to those given or received by the 
other half. In what way could “random’' halves of choices be 
taken to be equally representative samples of a specific kind 
of choice behavior of individuals in a specific group? Even if 
this assumption is somehow met (and no really satisfactory 
means of doing so seems to have been suggested), the possi- 
bility of ambiguity remains in interpretation of a coefficient 
computed on this basis from sociometric data. If the coeffi- 
cient of correlation is low, is the test lacking in internal con- 
sistency, or does the individual really play an inconsistent role 
in the group? If it is high, does the test possess a high degree 
of internal consistency, or does the individual play a consistent 
role in the group? The latter interpretations might lead to 
valuable inferences about the behavior of members in a group, 
but direct judgments about test reliability could not be made 
from this type of analysis. 

Again, it seems that a more fruitful approach would be made 
through a precise definition of "consistency” appropriate to a 
particular instrument and the purposes of a particular study. 
If several, or more, groups are involved in an investigation, it 
might be pertinent to ask whether within-group choices are 
homogeneous. If a study is concerned with the problem of 
within-group cleavage (e.g., preference for own group members 
of Negroes and whites, or Jews and Gentiles), it might be im- 
portant to know whether choices are given with significantly 
greater frequency to members of the own sub-group than to 
other members of the whole group. The techniques employed 
must be selected to meet the needs of a specific problem and 
to implement the careful use of a specific sociometric instru- 
ment. 

A clear description and delimitation of the application and 
procedure in carrying out a particular design are to be preferred 
to the loose borrowing of method and terminology from an 
allied, but different, field. This caution seems especially rele- 
vant, in view of the confusion already existing about the 
measurement of reliability of psychological tests. One writer 
previously cited has said, “The statistical formulas utilizing 
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reliability coefficients are based on assumptions at best so in- 
accessible, at worst so contrary to clinical experience, that the 
attempt to find a substitute for the notion of reliability, based 
on assumptions closer to the real situation in testing, appears 
well justified” (4, p. 10). 

Conclusions 

It was pointed out in discussing the problem of “validity” 
that sociometric test data are themselves the behavior which 
is studied. Choice responses are not "right” or “wrong” 
answers to test questions, in terms of reference to any key or 
to an outside criterion. If this is so, then variation of choice 
behavior from one test to another, or variation of the behavior 
within a group at a stated time, is not to be referred to as a 
function of “test reliability,” but of the relative stability of the 
behavior itself. It follows, then, that the empirical presenceof 
this kind of reliability, or the lack of it, to some degree, permits 
no value judgment about the “goodness” of the test. There 
are significant questions to be asked and answered about the 
relationships of choice behavior explicit in responses to socio- 
metric instruments, about choice behavior in other than testing 
situations, about the consistency of this “tested” behavior 
within a group, and about its stability over different periods of 
time. But these questions may be asked and answered with 
more understanding if they are put in terms appropriate to the 
test and to the situation. The concepts of “reliability” and 
“validity” as traditionally used — and misused — by psycholo- 
gists, seem to have little direct meaning or application to the 
field of sociometry. The systematic development of new con- 
cepts, in a new frame of reference, is indicated, a development 
in which rigorous statistical method is matched by rigorous 
theoretical definition. 
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EFFECT OF SPEED ON ITEM-TEST CORRELA- 
TION COEFFICIENTS 


ALEXANDER G. WESMAN 
The Psychological Corporation 

The practice of doing item analyses with items which have 
been taken under speed conditions has not been entirely aban- 
doned. Although most careful psychometricians have cau- 
tioned against this procedure, several instances have come to 
the writer’s attention recently in which the warnings have been 
unread or ignored. The reason, perhaps, may be that empirical 
demonstrations have not been sufficiently publicized to bring 
the principles to the attention of all of us who should be aware 
of them. Since the principles can to a large extent be theoreti- 
cally derived, we have tended to rely on theoretical discussions 
rather than on the presentation of experimental data. The 
present paper is intended to offer a discussion of theory and 
some supporting data. 

In the construction of objective tests, one sometimes de- 
liberately injects a factor of speed because of the conviction 
that speed is an important component of the ability to be 
measured. More frequently, this is not the reason. In most 
group tests, especially those designed for selection purposes, 
the speed factor represents a compromise for the sake of ad- 
ministrative efficiency. If it were feasible, untimed power 
tests would be used in the practical situation; since it is rarely 
expedient to use untimed tests, time limits are set which are 
often quite short. In setting these limits, it is assumed that 
there is considerable correlation between scores on the speeded 
test and the scores which would result if the test were given 
under power conditions. This assumption has sometimes been 
shown to have considerable validity; usually, the assumption 
is not even investigated. 

A decision as to whether speed is an important component 
of the trait being measured, or whether it is a practical ex- 



52 EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT 

pedient, should be made before test construction is begun. If 
speed is an essential component, then the criterion used in 
selecting items should take account of speed. If speed is recog- 
nized as an expedient, the criterion should be one which takes 
into account only power aspects of the ability. In this study 
the decision was made in advance that measurement of power 
was the real goal, and that speed was not to be regarded as an 
essential component. On this basis, the criterion score with 
which items were to be correlated was a power-test score — one 
obtained without time limits. It should be noted that a good 
outside criterion would have been preferred, had it been avail- 
able. But, as is true of the construction of many tests, it was 
impractical to obtain such an outside measure and the best 
available internal criterion was selected. 

This study was aimed at investigating the extent to which 
difficulty values and item-test coefficients obtained under power- 
test conditions would have changed if the tests had been given 
under speed conditions. Two experimental forms (A and B) 
of a general intelligence test were prepared, each containing 
138 items. The four types of items in each form were presented 
in cycle-omnibus fashion in the following order: (1) Analogy, 
(2) Analogy, (3) Synonym, (4) Classification, (5) Arithmetic 
computation, (6) Analogy, (7) Analogy, (8) Synonym, (9) 
Classification, (10) Arithmetic computation, etc. The items 
were arranged within each item form according to the guessed 
level of difficulty; how successful this guessed order was may be 
seen by inspecting the difficulty values in Table 1. 

The tests were administered to a group of applicants to 
schools of nursing. 1 One hundred and twenty of these women 
took Form A and one hundred and twelve took Form B of the 
test. Their instructions were to work as rapidly as possible 
and to mark, at successive five-minute signals, the item on 
which they were working. All applicants were permitted to 
finish the test; the shortest time taken was between 15 and 20 
minutes, the longest time between 30 and 35 minutes. The 
number of the item each applicant had reached at the end of 


1 The author is indebted to Edith M. Potts, Director, Nurse Testing Division, The 
Psychological Corporation, for these subjects. 
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each five-minute interval was recorded on her test sheet by 
the scorers. 

For purposes of constructing the desired test, item-test 
correlations against the total score on the test were computed. 
For purposes of the investigation herein reported, however, a 
different set of data was gathered. The author arbitrarily 
hypothesized two tests, each consisting of the first eighty items 
of the longer experimental forms. He further hypothesized 
that these eighty-item tests had been given with a ten-minute 
time limit. He was then able to score each test in terms of 
the number of items (out of the first eighty) correctly answered 
in the first ten minutes. 

An item analysis performed on this eighty-item, ten-minute 
test would indicate the results which might be expected if a 
speed test of the kind hypothesized had actually been adminis- 
tered. Such an analysis was made, using the upper ij per 
cent and lower 27 per cent (based on the 138 item power forms) 
of the applicants taking each form. The proportions of the 
upper and lower groups passing each item were located on the 
Flanagan chart devised to provide item-test coefficients for 
such groups. These values (Speed r . t ) appear in Table 1 for 
Forms A and B. 

In obtaining the proportion of applicants passing an item, 
the fiction of an eighty-item, ten-minute test was maintained. 
A subject who passed an item after the first ten minutes was 
not included in the passing group; had only ten minutes been 
available, she would not have reached the item, and therefore 
would not have passed it. In this way, the conditions of the 
fictional speeded test were observed. 

Since, in fact, we have available the responses of all applicants 
to all of the eighty items, item-test coefficients can also be com- 
puted which will include all applicants who passed an item, 
regardless of whether it was passed before or after the expira- 
tion of ten minutes. Coefficients thus computed may be 
properly considered power-test coefficients. These coefficients 
are presented alongside the speed coefficients in Table x. 

As we inspect the item-test coefficients, we find that for the 
first twenty-eight items of Form A, and the first forty-one items 
of Form B, there is no difference under the speed vs. power 
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TABLE i 


Average Per Cent Passing and Item-Test Coefficients under Speed and Power Conditions 


Form A 

SPEED POWER 
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conditions. 
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TABLE i — Continued 


Form A Form P 
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conditions, This reflects the fact that all applicants in both 
the upper and lower groups reached those items in the first 
ten minutes. As we proceed further into the table, differences 
begin to appear. These differences indicate that some appli- 
cants in the lower groups could have answered the items cor- 
rectly, had they been able to reach those items within ten 
minutes. As we reach item 70 in each form, the differences in 
item-test coefficients under speed and power conditions are 
caused by the failure of applicants in the upper as well as the 
lower groups to reach items 70 to 80 within the prescribed time 
limit. 

Perhaps the most dramatic aspect of the decreases in item- 
test r as we turn from speed to power conditions is their un- 
predictability. Knowing the coefficient under speed condi- 
tions, we can make no reasonable guess as to what the power 
coefficient will be. We can usually be certain that the co- 
efficient will decrease; whether it will still be respectably large 
after it decreases, or whether its significance will disappear, 
cannot be foretold. 
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For example, in Form A, item 56 has a speed item- test co- 
efficient of .77; under power conditions, this value falls to .51, 
which still leaves the item extremely valuable. Its neighbor, 
item 57, starts with a speed coefficient of .72, which falls away 
to exactly .00 under power conditions. 

It is obvious that the high item-test coefficient obtained for 
item 57 under speed conditions is purely an artifact of its late 
location within the test. Similarly, its difficulty value under 
speed conditions is the identical kind of artifact. Had item 57 
been made item 1 instead, the average per cent passing it would 
have been 97 per cent, instead of 67 per cent. The difficulty 
of an easy item is just as poorly evaluated under speed condi- 
tions as the item’s internal consistency. A ridiculously easy 
item, of no true discriminating power, will appear more difficult 
and highly valid if placed far enough along in the test. Thus, 
we can predict with considerable confidence, that had item 70 
of Form A been “write your own name,” the speed item-test 
coefficient would have been at least .84, and the average per 
cent passing would have been no higher than 50 per cent. 

It is clear, then, that item-test coefficients and item-diffi- 
culty indices derived under speed conditions are highly am- 
biguous. It may be proposed that they might be made more 
satisfactory if they were based only on subjects who actually 
responded to each item, thereby removing the effect of“omits,” 
This is not an entirely satisfactory solution. Dr. Davis, in 
his excellent monograph on item-analysis data, deplores the 
use of speed tests when item analysis is intended and notes the 
difficulties which arise when some of the subjects do not reach 
every item. He recognizes that if tests are speeded there are 
two alternatives: (1) to include in the item analysis only those 
who have reached the item, or (2) to include the “non-reads” 
in the analysis group. He prefers to base the analysis on the 
group which readies the item, even though this results in a 
constantly decreasing number of subjects, in the expressed 
belief that this is the lesser of the two evils. The writer tends 
to agree that including those who fail to reach an item in the 
analysis is the greater evil, but he wonders whether one can 
really choose between them. When the correlation between 
speed and power is zero, one might argue that those who reach 
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an item are more or less representative of the entire group. 
For the tests used in this study, the correlation between the 
eighty-item speed scores and scores based on those same eighty 
items under power conditions was about .75. Correlation of 
that magnitude is strong evidence that those who reach the 
later items are more proficient and therefore unrepresentative. 

The most satisfactory procedure seems to be to give the test 
in its experimental stages under power conditions, allowing 
enough time for everyone to reach every item. After item 
analysis and selection have been done on that basis and the 
items have been ranked in ascending order of difficulty, ap- 
propriate time limits should be set and the test run again for 
normative purposes. The indices which we would obtain if 
we analyzed the items after injecting speed would not be the 
same as those obtained under power conditions, but that fact 
need not be a source of concern. If the items worked under 
power conditions, they should also work under speed condi- 
tions. The effect of mental set, which doubtless changes as 
we go from power to speed, will probably be of some importance. 
Its precise effect is difficult to evaluate. We can be quite 
certain, however, that the change in mental set will not seri- 
ously disturb the relative merits of the individual items and 
that it will not be of the same order of importance as is the 
placement of the item under speed conditions. 

The writer recognizes that the number of cases in his item 
analysis groups is very small, and that the item-test coefficients 
and difficulty indices presented in the table are not very re- 
liable. He believes nonetheless that the data are sufficient to 
substantiate his main thesis — that item-analysis data from 
speed tests are practically worthless. 
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the professed and measured interests of 

VOCATIONAL REHABILITATION COUNSELORS 1 

SALVATORE G. DrMICHAEL 
Federal Security Agency 

This article is a partial report of a broad study designed to 
secure a better understanding of personnel engaged as voca- 
tional rehabilitation counselors for the civilian disabled. The 
program has been in existence since 1 920 and was considerably 
expanded by public legislation in 1943 to serve the mentally as 
well as the physically disabled. The inclusive legislation of 
1943 required large increases in staff. Many training institutes 
were conducted all over the country to assist in orienting the 
counselors to their work (9). Coincident with the institutes, 
this and other studies were conducted. 

In order to make the results of this report more intelligible, 
a few other facts should be mentioned as background informa- 
tion. The work of the rehabilitation counselor is most varied 
and complex in this State-Federal program for the civilian dis- 
abled (3). The counselors deal continuously with the client 
from first referral through placement and follow-up. In be- 
' tween, the client receives all of the services necessary to become 
successfully employed at the occupational level of his highest 
pattern of abilities. The client always receives the services of 
counseling, medical examinations, and assistance in placement 
but he may also secure medical and psychiatric treatment, 
hospitalization, prosthetic appliances, specialized psychological 
evaluation (4), all forms of training including university educa- 
tion, necessary occupational tools, help in setting up small 
businesses, and a number of other services necessary for reha- 
bilitation. The average case takes about nine months from 
referral to follow-up in remunerative employment. One of our 
psychological colleagues has said that rehabilitation counselors 
have to “live with their diagnoses.” 

1 The author gratefully acknowledges the assistance given by Donald H. Dabelsteitt 
in the initial steps of the study, and by Marjorie Moore in the statistical computations. 
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Specific Purposes of Phis Study 

Specifically, this report attempts to answer the following 
questions: 

i. What is the typical profile of vocational rehabilitation 
counselors on the Kuder Preference Record ? 

i. How stable are the scores on the Kuder with increasing 
experience on the job? 

3. What reasons are given for and against the use of the 
Kuder Preference Record by counselors who have used it? 

4. What is the relationship between professed degree of 
interest in the nine vocational areas of the Kuder, and the 
actual scores of measured interests? 

5. Does the administration of the Interest Inventory and the 
knowledge of scores made on it influence the individual to 
estimate his self-interests in the direction of the test results? 

Phe Experimental Population 

The rehabilitation counselors who comprised the experi- 
mental population number 146 and come from fourteen States 
including Alabama, California, Florida, Georgia, Mississippi, 
North Carolina, New Jersey, New York, Ohio, Pennsylvania, 
South Carolina, Tennessee, Texas, and West Virginia. This 
number is divided into two groups, known as Groups A and B. 
Group A numbered 100 counselors, and furnished the major 
data for many phases of the total investigation. Group B 
numbered 46 counselors and was introduced mainly for the 
purpose of determining whether the prior administration of 
the Kuder Preference Record prejudiced the degree of professed 
or "subjective” interests in nine general vocational areas. 
Group A numbered 134 at the beginning of the experiment but 
only 100 complete sets of data were available for analysis. 
This represented 75 per cent of the original group. Some in- 
complete data made it necessary to exclude 24 cases. The re- 
maining 10 had been separated from service. Only male coun- 
selors were included in this study, although subsequent analysis 
showed that the typical interest profiles of the male and female 
counselors were fairly similar. 

The counselors were requested to fill out a “Background In- 
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majors and minors in both college and graduate school. An 
over-all analysis of these majors and minors leads to the con- 
clusion. that the preponderance lie in the fields of Education 
and Social Studies, with subjects such as Psychology and Guid- 
ance seldom mentioned. The data on educational background 
were an expected reflection of the group’s inadequate training 
in the fields of vocational counseling and rehabilitation case 
work. The universities and colleges of our country had not 
set up appropriate training courses in the past to permit the 
State directors of public civilian rehabilitation to select fully 
trained counselors for their agencies. The expansion of the 
civilian rehabilitation program had to be made, and the most 
suitable personnel selected as they were available. Further 
necessary training had to be provided on the job; this fact made 
us give major emphasis to in-service training in many forms. 

Method of the Experiment 

The counselors first were contacted at the orientation insti- 
tutes. There they received instruction in the basic methods of 
case work within the framework of the public program for the 
civilian disabled. During the session on Psychological Evalua- 
tion, the counselors of Group A were asked to take the Kuder 
Preference Record for the purpose of becoming acquainted with 
its use and interpretation. They were requested to hand in 
their interest profile record if they wished and were given as- 
surance that the individual results would be kept confidential. 
Five months later, on the average, a “Survey Sheet” was mailed 
to the volunteer participants. In the Survey Sheet, they were 
asked to indicate, among other items, their degree of professed 
or “subjective” interest in the nine vocational areas similar to 
those of the Kuder. At the same time, the covering letter 
asked them to take the Kuder again. Therefore, on each 
counselor of Group A, the experimenter obtained an initial 
profile of measured interests and five months later a second 
profile in addition to their opinions of the professed interest in 
each of the nine general vocational areas similar to those of the 
Kuder. 

Group B was first given the “Survey Sheet” and asked to 
indicate the degree of interest in each of the nine vocational 
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areas. It had been ascertained beforehand that they had not 
been acquainted with the contents of the Kuder. Immediately 
after they had filled out the Survey Sheets and handed them in, 
the Kuder Preference Record was administered and the profiles 
collected. By a comparison of the results between Groups A 
and B, we wished to ascertain the extent to which the Kuder 
influenced the professed opinions on degree of interest. In 
other words, we desired to find out whether a person who took 
the Kuder tended to change his mind about his "subjective” 
interests in the direction of the obtained “objective” scores. 

‘Typical Interest Profile of Vocational Counselors 

The Kuder scores made by the counselors were analyzed for 
Group A, first and second administrations, and for Group B. 
The average scores are presented in Tables 3 and 4, together 
with other data. Within the parentheses are shown the percen- 
tile equivalents of each average score. The highest score is in 
the Social Service area, with second highest in the Persuasive 
area, and the third highest in the Literary scale. The other 
scores scatter between the 24th and 42nd percentile points, 
with the scores in the Artistic scales placing last or tied for 
last. 

It was now necessary to determine whether the differences in 
scores between the first administrations of the Kuder test given 
to Groups A and B were statistically significant. Accordingly, 
the“t” ratios were calculated for the differences between mean 
scores. All the “t” ratios were well within the range of statis- 
tically insignificant differences as may be seen from the data 
in Table 3. These results show that Groups A and B were not 
different with respect to the results on the Kuder. 

The study also sought to find out whether additional coun- 
seling experience would have an appreciable effect upon the 
pattern of measured interests. This point could be answered 
by analyzing the differences in scores between the first adminis- 
tration of the Preference Record and a retest given on an 
average of five months later. The analysis is presented in 
Table 4. It shows that all differences are statistically insig- 
nificant except for the Social Service scale. The change of 
average scores on the latter was statistically significant beyond 
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the one per cent level of confidence. However, the percentile 
scores, which correspond to the means, changed only one point. 


TABLE 3 

Measured Interests of Two Groups of Counselors Obtained on the Kuder Preference 

Record 


Scale 

Means 

Gr. A Gr. B 

m a-b 

Standard Error 

m, 

S ' E A-B 

Wyt 

ratio 

Mechanical 

72.13 

63.20 

6.93 

2.02 

3 59 

4.12 

1 .68 


(36)* 

(26)* 




Computational 

31 ,9’ 

29 91 

a. 00 

I OI 

I .70 

I.98 

I .01 

(.39) 

(32) 

3 63 





Scientific 

61.07 

57-44 

1-43 

i 94 

2 42 

1 5 1 


(33) 

(26) 

— 1 . 6t 

I .69 



Persuasive 

79-43 

8x 04 

2 57 

3 08 

— 0 52 


(8a) 

(84) 

■ 36 




Artistic 

37 - 3 ° 

(24) 

30 30 
(62) 

14-2 5 

30 94 
(23) 

52.48 

( 68 ) 

14 94 

1.23 

1. 9 i 

2 27 

0.16 

Literary 

—1.98 

I .48 

2 37 

2 79 

“0.71 

Musical 

— 69 

• 94 

* 55 

I 8l 

—0.38 


(39) 

(42) 

— . 16 



Social Service 

97 28 
' ( 98 ) 
47*54 

97 - 4 + 

(98) 

49.94 

1 , 69 

2. 36 

3-07 

~o 05 

Clerical 

— 2,40 

1 20 

2.37 

2.63 

—*0.91 


(30 

(38) 




* Numbers within parentheses represent percentiles corresponding to , 

mean scores. 
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Measured Interests of a 

Group of Vocational Counselors as Effected by Floe Months 

Additional Counseling Experien 

ce 




Scale 

Means 

Change 

Standard Error 

S E.i-s 

»t” 

Teat l 

Retest 2 

M1-1 

Test 

Retest 

ratio 

Mechanical 

72 13 

72,28 

• 15 

a 02 

2.12 

2.93 

.03 


(36)* 

(36)* 




Computational 

31 91 

29 85 

— a. 06 

1 .01 

I .08 

1.48 

-i -39 


(39) 

(31) 






Scientific 

61 07 

58.38 

— 2,69 

1.43 

1. 41 

2 01 

-I 34 


(33) 

(28) 



Persuasive 

79.43 

83.21 

3*78 

1 .69 

i 73 

2.42 

1.36 

Artistic 

(82) 

(87) 




37 - 3 « 

38.12 

.82 

1 23 

I 32 

1 .80 

•42 


(24) 

(25) 





Literary 

30 30 

49-58 

— 92 

1 ,48 

I 46 

2 08 

-.44 


(62) 

( 59 ) 





Musical 

14.23 

15.07 

. 8a 

•94 

88 

1.29 

.64 


( 39 ) 

(42) 



Social Service 

97 28 

103 38 

6.30 

1,69 

2-53 

2.28 

2,7 6 

Clerical 

( 98 ) 

( 99 ) 




47-54 

45 . 5 I 

—a. 03 

I 20 

I . 20 

r 70 

— 1.20 


(31) 

(25) 







* Numbers within parentheses represent percentiles corresponding to mean scores. 


This affected in no material way either the pattern of measured 
interests or the magnitude of the scores within the pattern. 
To construct a typical profile of measured interests for voca- 
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tiowal rehabilitation counselors, the scores made by Groups A 
and B on the first administration of the Kuder were put to- 
gether. The results are depicted in Figure I, which includes 
the statistics on average scores, the percentile equivalents, and 
the standard deviations. 



Mcchatt- Computa- Scien- Persua- Artistic Literary MuBieal Social Clerical 
ical tional tlfic aivc Service 

Fig I Typical Kuder Interest Profile of 146 Vocational Rehabilitation Counselors 


( ) = Percentiles 
0.00 Average Score 

0.00 Standard Deviation 

Counselors’ Reasons For Using or Not Using the Kuder 

One of the questions on the Survey Sheet was “What are 
some (one or more) reasons why you choose to use the Kuder 
Preference Record or choose not to use it?" This item was to 
be answered only by those counselors who had used the Kuder 
in their work. There were 12.6 reasons given in favor of, and 
30 against, the use of the Kuder. The classification of re- 
sponses was somewhat difficult but the complete enumeration 
of the answers is presentedjbelow. 
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In terms of the attempted classifications, the most frequently- 
mentioned value of the Kuder is that it helps “To determine 
objective or real interests” (49) . Closely following one another 
in frequency were answers grouped under “Serves as Guidance 
Aid to Counselor, Client, or Both” (25), “Ease of Administra- 
tion, Scoring, and Interpreting” (21), and “Validity and Sci- 
entific Value” (18). The most frequently mentioned of the 
classified responses against the use of the Kuder were “Lack of 
Time to Administer” (8), “Limitations of the Kuder” (7), 
“Agency has not made it available” (5), and “Unsuitable for 
Rehabilitation Group” (5). 

Reasons for Using Kuder in Rehabilitation ( Total — 126 responses) 

A, To Determine Objective or Real Interests (49) 

Locates general field, of interests — 10 
Indication of real interests — 7 
Verifies expressed interests of client — 6 
Determines interests when client is undecided about ob- 
tive— 5 

Indication of latent interests — 4 

Used with young people to determine interests — 4 

Discovers interest fields of disabled clients — 3 

Gets interest combinations — a 

Finds degree of interest — 2 

When clients express no interests or transitory interests 


2 

Covers areas of interest for most of our clients- — 2 
Discovers interests of client with no work record — 1 
When there is a lack of subjective interests — 1 
B. Guidance Aid for Counselor, Client or Both (25) 

Check on client's expressed work objective — 6 
Helps in making decisions — 3 

Determines type of battery of aptitude tests to use — 2 
Secure greater rapport with client — 2 
Gives better over-all picture — 1 

Assists in clarifying interviewer’s impression of client — 1 

Serves as a check and balance to counseling — 1 

Basis for starting point — 1 

Aid in justifying decision — 1 

Secures lead for further exploration — 1 

Interest is vital element in rehabilitation — 1 

Helps in vocational guidance — 1 

Aids in stimulating client to think about his capabilities 

— 1 

Emphasis of selection shifted to client — 1 
Makes final decision more certain — 1 
Helpsjin setting up job objective — t, 
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C. Ease of Administration, Scoring and Interpreting (21) 

Ease of scoring, interpreting and administering — 12 
Easily given in high-school guidance program — 4 
Easily given to clients — 2 

Can be taken home by client — 1 
Results available immediately — 1 
Interesting to give and take — 1 

D. Validity and Scientific Value (18) 

Gives scientific basis to counseling — 8 
Apparent validity — 7 

Correlation between interests and success — 2 
Correlates with self-appraisal — 1 

E. To Indicate Aptitude (7) 

Index to interests and aptitudes — 3 

Checks young people’s aptitudes against interests — 1 

Statement of segregated aptitudes — 1 

Measure of potential abilities — 1 

Helps determine aptitudes — 1 

F. Familiarity and Availability (3) 

Only test available — a 

Only test with which counselor is familiar — 1 

G. Comparison with Other Inventories (3) 

Best available — 3 

Reasons for Not Using Kuder in Rehabilitation ( Total — 30) 

A. Lack of time to administer (8) 

Lack of time to test and score — 6 

Good for large groups, not for individual cases — 2 

B. Limitations of the Kuder Record (7) 

Items unsuitable for rural population — 2 
Fields too broad— 1 

Varying degrees of inconsistency — 1 
Results can be controlled or influenced — 2 
Mechanics inconvenient — 1 

C. Inventory not available (5) 

Not available — 3 
Supply limited — 2 

D. Unsuitable For Rehabilitation Group under Usual Condi- 

tions (j) 

Many clients lack education to read — 3 
Conditions of interviewing not conducive to good results 
— 1 

Not useful for clients with occupational background — 1 

E. Miscellaneous (5) 

Test given by psychologist, not counselor — 3 
Clients reactions to oral questioning as effective — 2 

Reliability of Measured Interests 
The scores made by the counselors on the Kuder test and a 
retest administered on an average of five months later were 
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analyzed for reliability. This procedure would make it possible 
to determine whether the scores remained stable enough so 
that one could predict with a high degree of confidence. The 
analysis was made in two ways : first, by computing the coeffi- 
cients of correlation between first and second scores on each 
scale, and second, by drawing graphs to show the stability of the 
letter grades assigned to the scores. The latter are not shown 
in this report although some of the results are mentioned below. 

In Table 5, it will be seen that all of the correlation coeffi- 
cients but two are .83 or above. Coefficients of this magnitude 
are usually interpreted as high and satisfactory for individual 
predictions. The two other coefficients were .70 and .72 for the 


TABLE $ 

Test-Retest Correlation Coefficients of the Measured Interests oj Vocational 
Rehabilitation Counselors 


Scale 

“r" 

SE. r 

Mechanical 

»s 

.03 

Computational 

.83 

.03 

Scientific 

.84 

.03 

Persuasive 

72 

■ os 

Artistic 

.84 

■03 

Literary 

.89 

.02 

Musical 

.83 

03 

Social Service 

.70 

• OJ 

Clerical 

.83 

.03 


Social Service and Persuasive scales respectively. These cor- 
relations also may be considered high in view of the highly 
selected population on which they were computed. Scores in 
the Social Service and Persuasive areas were well bunched in 
the upper levels of their scales. 

When levels of interest are judged in terms of letter grades 
of A, B, C, D, the stability of the scores in the Persuasive and 
Social Service areas is striking. (Kuder assigns A to scores 
above the 75th Percentile, B to scores between the 65th and 
75th Percentiles, C to scores between the 25th and 65th, and D 
to the lowest scores.) On the Social Service scale, 91 pairs of 
the letter grades remained in the A level upon retest. On the 
Persuasive scale, only 31 letter grades changed places on retest 
of which 16 changed one grade, and 4 changed from D to A. 
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Relationship Between Self -Estimated and Measured Interests 

Although other studies have sought to determine the degree 
of correspondence between self-estimated and measured in- 
terests (1), (t), (7), we wondered whether the results applied 
similarly to as mature and sophisticated a group as the coun- 
selors in this study. One phase of the experiment, therefore, 
was designed to find out to what degree the objective scores 


TABLE 6 

Correlations Between Measured Interests and Self-Rating of Degree of Interest in 
Nine Vocational Areas 


Scale 

Group A 

Kuder 2nd vs, Kuder 1st vs 
Self-Rating Self-Rating 

Group B 
Kuder 1st vs 
Self-Rating 

(cols. 

4 - 3)* 

Mechanical 

•75 

\}t 

6 2 

I ,20 

Computational 

59 

.62 

■ 54 

Scientific 

■7 a 

•71 

■37 

2.9O 

Persuasive 

. 61 

-54 

• 43 

.8$ 

Artistic 

.44 

■38 

■ a 4 

•9 2 

Literarv 

Musical 

■63 

-58 

5* 

.52 

. 1 ° 

,64 

.62 

.20 

Social Service 

• 59 

48 

.68 

1 80 

Clerical 

(Median) 

■ 52 

.48 

55 

■56 

.61 

(.56 

(•55) 


* Resulting “t 1 ’ ratios were computed according toSnedecor’s method of testing for 
significance of the difference between two correlations by converting to z as an inter- 
mediate step. C. F. George W. Snedecor, Statistical Methods, Ames, Iowa* The Iowa 
State College Press, 1946, p. 1 51, 

correlated with the counselors’ professed degree of interest in 
the nine areas of the Kuder. 

In order to obtain the self-estimates of vocational interest- 
areas, the Survey Sheet included a series of rating scales. The 
accompanying instructions required the counselor to show to 
what degree he enjoyed activities in the nine vocational fields. 
The rating scale was in the form of a continuous line with the 
following guide points from left to right: (Enjoy) Not at all, 
Indifferently, Fairly Well, Much, Very Much. The recorded 
ratings were translated into numerical scores by converting 
the scale into units from o to 20. The Kuder scores were then 
correlated with the numerical scores as derived from the rating 
scale of the Survey Sheet. The results are shown in Table 6. 
Since the design of the experiment called for only one adminis- 
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tration of the Kuder to Group B, the correlations of the latter 
group are half as many as for Group A. 

It will be seen that there is a substantial but not very high 
relationship between self-estimated and measured interests for 
this mature group of counselors. The range of correlations is 
from .2,4 to .75 with medians of .55 and .61 for counseling 
Groups A and B respectively with regard to measured interests 
on the first Kuder test versus self-ratings. The highest cor- 
relations appear in the Mechanical and Musical scales, and the 
lowest in the Artistic scale. 

As the experiment was being carried out with Group A, it 
was observed that the counselors would take the Kuder, and 
after noting the results on the graphic profile, sometimes would 
remark, “Just as I figured myself.” The question arose 
whether the administration, scoring, and interpretation of the 
Kuder, would have the effect of “fixing” the person’s self- 
estimates of his interests. It was conjectured that a person’s 
self-estimates of interests would be less in line with the Kuder 
results if he were asked to express his interests before taking 
the test. 

To test this hypothesis, Group B was included in this in- 
vestigation. The members of this Group were first requested 
to fill out the Survey Sheet, before taking the Kuder. Only 
counselors who had no previous familiarity with the Kuder were 
included in Group B. Although Group A had been advised, 1 
“Try not to be influenced by the scores on the interest inven- 
tories which you have taken,” the possible influence could not 
be discounted without experimental proof. Hence, the experi- 
mental design sought to detect the influence of the Kuder scores 
upon the subjective ratings of professed interests. 

In Table 6, an inspectional comparison can be made of the 
correlations between self-estimated interest and test scores for 
Groups A and B. The data barely suggests that foreknowledge 
of one’s Kuder interest profile has a very slight effect upon their 
self-estimates. In the first place, six of the nine correlation 
coefficients for Group B are lower than the corresponding co- 
efficients in each of the two administrations for Group A. 
Another indication of the slight trend may be deduced from 
the median coefficients for the three different conditions of ad- 
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ministering the Kuder. With no foreknowledge of Kuder 
scores, the median correlation coefficient between measured and 
professed interests for the nine scales is .55 for Group B. For 
Group A which had foreknowledge of its Kuder scores, the 
median correlation is .56 when the first Kuder test is involved, 
and .61 with the second interest test. 

The indications above consistently suggest that a knowledge 
of the Kuder results slightly influences self-estimates of interest 
in the direction of the objective measurements. However, this 
statement is made very guardedly. Applying the test of the 
significance of the difference between correlation coefficients 
of Groups A and B (when self-estimated interests and 1st Kuder 
scores are involved as the variables for each correlation co- 
efficient), the ratios are all statistically insignificant except for 
the Scientific scale. The "t” ratios are shown in Table 6, It 
is not possible with the data at hand to account for the one sig- 
nificant difference when the differences between correlations 
are insignificant for all other eight scales. Perhaps the matur- 
ity and sophistication of the counseling group accounts for the 
resistance to change in their self-estimated interests. An ex- 
periment similar to this but with younger student groups may 
show that the Kuder results tend to fix professed interests in 
line with the results of objective measures. Such an experi- 
ment would seem to be worthwhile in view of the usual asser- 
tion by psychologists that interest inventories encourage self- 
analysis and decisions on vocational preferences. 

Summary 

Two groups of vocational rehabilitation counselors were re- 
quested to take the Kuder Preference Record and to express 
their self-estimates of interests under two somewhat different 
sets of conditions. Group A of 100 counselors filled out the 
Kuder, then on an average of five months later were asked to 
retake the Kuder and fill out a Survey Sheet in which was re- 
corded their self-estimated degree of interest in the nine voca- 
tional areas similar to those of the Kuder. Group B were first 
asked to express their subjective interests in the Survey Sheet, 
then to take the Kuder the same or next day. 

The typical profile of measured interests was: Social Service 

(s 8 p )>. Persuasive (82 P), literary (65 P) t Musical (40 P), 
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Computational (37 P), Mechanical (33 P), Clerical (33?), 
Scientific (31 P), Artistic (28 P). The individual scales on the 
Kuder were found to have a high retest reliability, the coeffi- 
cients being .83 and above, except for the Social Service and 
Persuasive scales with coefficients of .70 and .7 a respectively, 
In view of the highly selected type of population, the reliability 
coefficients are considered highly satisfactory. 

The relationship between measured and self-estimated in- 
terests ranged from .24 to .75 for the broad vocational areas as 
represented in the Kuder Prejerence Record. The median co- 
efficients on the nine scales were .55 and .61 for Groups A and 
B respectively. The changed experimental conditions for 
Group B gave some very slight and highly unreliable indications 
to show that foreknowledge of Kuder measured interests would 
influence self-estimated interests in the direction of measured 
interests. The latter results raise the question whether less 
mature student groups would change or stabilize their notions 
of self-estimated interests by taking an objective inventory like 
the Kuder. 
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PREDICTING MATHEMATICS GRADES OF VETERAN 
AND NONVETERAN STUDENTS 

NORMAN FREDERIKSEN 
Princeton University 

Introduction 

The need has often been felt in the Counseling Service at 
Princeton University of a sound basis for predicting success in 
the introductory courses in mathematics. Since mathematics 
is a key subject for students who concentrate in the physical 
sciences and in engineering, the prediction of success in be- 
ginning mathematics courses may be quite helpful in counseling 
students regarding the advisability of entering such fields. 
An adequate method of predicting achievement in mathematics 
is also of value to faculty advisors, who, for example, frequently 
must assist a student in deciding on the advisability of taking 
Mathematics lor (Algebra and Trigonometry) or Mathematics 
103 (Elementary Calculus). 

Several appropriate predictive measures are ordinarily 
available for Princeton students. These measures include the 
College Entrance Examination Board Scholastic Aptitude lest 
scores, both Verbal (SAT-V) and Mathematical (SAT-M), 
and the Converted School Grade (CSG). The CSG is a pre- 
diction of freshman average grade at Princeton which is ob- 
tained from the student's rank in his high-school class. In 
computing a student’s CSG, a correction is introduced which is 
based on the past records at Princeton of students who came 
from his particular school. 

The presence of a large number of veteran students in recent 
years has resulted in two special problems in connection with 
the prediction of success in mathematics courses. The first 
problem resulted from the fact that for a fairly large proportion 
of the veteran students the usual predictive measures were not 
available, either because veterans were admitted on the basis 
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of General Educational Development Test scores or they were 
admitted through a college training program such as the V-12. 
This problem suggested the desirability of obtaining Princeton 
norms for some other easily administered mathematics test 
and of studying its predictive value. The Cooperative General 
Achievement Test, Part III, A Survey T est in Mathematics, 
Form O, was selected for this purpose in collaboration with a 
member of the Department of Mathematics. 

Secondly, there was the question of whether or not the 
predictive measures were equally applicable to veteran and 
nonveteran students. The belief seems to be prevalent among 
educators (a) that veteran students are doing exceptionally well 
in college, that their achievement exceeds that which would be 
predicted on the basis of tests of aptitude. It therefore seemed 
desirable to study the predictive value of the tests for veterans 
and nonveterans separately, in order to determine whether or 
not the regression formulae would apply equally well to both 
groups. 

The three purposes of this study, then, were as follows: 

1. To develop local norms for the Cooperative Survey Test in 
Mathematics. 

n. To investigate the value of various predictive measures 
for forecasting grades in mathematics courses. 

3. To study the relation of veteran or nonveteran status to 
achievement in mathematics at Princeton. 

The Data 

The Cooperative Survey Test in Mathematics was administered 
during the first week of classes in the fall of 1946 to all students 
enrolled in Mathematics 101 or 103. The test was administered 
in a regular class period by the mathematics instructors. 
The groups to which this test was given were used as the basis 
of the study. These groups consisted of 500 students in 
Mathematics 103 and 94 students in Mathematics ioi. All 
students enrolled in these two courses were included except the 
absentees on the day of giving the test. 

In addition to the Survey Test scores, certain other data were 
obtained. College Board Scholastic Aptitude Test scores, both 
Verbal and Mathematical, and the Converted School Grades 
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were obtained from records in the registrar’s office. Some 
veteran students had taken the Special Aptitude 'Test for 
Veterans (SV) rather than the Scholastic Aptitude Test. SV- 
Verbal test scores were converted to SAT-Y test scores by 
means of a graph which was constructed from a regression 
formula supplied by the College Entrance Examination 
Board. Such a conversion was necessary only for the verbal 
scores. 

Final grades in Mathematics ioi and 103 were used as the 
criteria of success. The Princeton grading system involves 
seven groups, with Group 1 representing high achievement and 
Group 7 low achievement. Plus and minus categories are also 
used. Groups 6 and 7 are both failing grades. The following 
conversion table was used for course grades (and for CSG) in 
order to turn the scales right side up and to avoid the plus and 
minus categories: 
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11 

4+ 

11 

I 

10 
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11 
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19 
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16 
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3+ 

15 
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14 

7 

a 

3~ 

'3 




Grades of 6-f , 6 — , 7+, and 7 — are not used. 

Other data were obtained from blanks filled in by students on 
the cover of the test booklet; these included age, year of high- 
school graduation, number of terms of mathematics previously 
studied (in high school or college), academic status (freshman, 
sophomore, etc.), and whether veteran or nonveteran. 

Using a sample of 169 veteran students, a correlation of .88 
was found between age and year of high-school graduation. 
Since the two variables are closely related, only one of them was 
used. Tear of high-school graduation was selected, because 
recency of graduation seemed more likely to be related to 
academic success than age. 

Still another variable used in the study was a measure of 
reading ability known as Level of Comprehension. Level of 
Comprehension is one of the scores obtained from the Co- 
operative English Test C2: Reading Comprehension , which has 
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been given each fall to newly entering students at Princeton, 
This variable was selected because it is a measure of compre- 
hension rather than speed in reading. 

Princeton Norms 

Norms were developed far use in interpreting Cooperative 
Survey Pest scores at Princeton. By means of a conversion 
table (Table >) it is possible to convert scaled scores to per- 
centile ranks based on that portion of the Princeton population 


TABI.F 1 

Norms for Ceofvf Mite Sstrtry Test in Aial+ntutfirt 
(Based on 9,4 students enrolled in Mathematics 101 a nd cm students in 
Maiiicmotic' let. ScESerobcf 1946) 



IVi’arsauk JUnfc. 

*« 

m 

88 

95 

*5 

*sq 


*5 



Bo 

75 

79 

77 

£ 

75 

50 

73 

40 

71 

.to 

TO 

75 

69 

UtO 


»$ 

66 

JO 

63 

5 

57 

1 


which in the fall of 1946 was enrolled in one of the beginning 
mathematics courses (roi or 103). 

These norms should not be thought of as Princeton norms or 
even as Princeton freshman norms, since those students in the 
mathematics courses undoubtedly represent a select group with 
respect to mathematical ability. The mathematics-student 
norms are, as a matter of fact, more useful than general fresh- 
man norms would be. When advising a student regarding 
mathematics courses, his comparison with mathematics 
students is more relevant than his comparison with Princeton 
students in general. 
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The mean scaled score for the Princeton students is 75.0, 
According to the Educational Records Bureau, the median for 
entering college freshmen is 58.5, and for independent-school 
seniors with four years of mathematics the median is 74.2. 

Prediction of Success in Mathematics Courses 

The intercorrelations of the various predictive measures 
with final grades in the two mathematics courses are shown in 
Tables 1 and 3. The N’s have been reduced to some ex- 
tent because of the desirability of basing all the correlations 
on the same sample in order to make it possible to compute 
multiple correlations. Thus only cases with complete data 
could be included. The loss of cases was greatest for veterans 
because of the fact that some of them were admitted with 
GED test scores rather than College Board scores, and some 
were admitted through the V-ia program and had no aptitude 
test scores at all. The intercorrelations of the variables for the 
Mathematics 103 students were based on 170 veterans andn.50 
nonveterans. The samples for the Mathematics 101 students 
were much smaller, there were only 36 veterans and 39 non- 
veterans for whom data were complete, even though Level of 
Comprehension was eliminated. The statistics for Mathe- 
matics 101 are therefore considerably less reliable than those 
for Mathematics 103. 

The column in T able 1 headed Mathematics 103 Final Grade 
contains the validity coefficients for the predictive measures. 
Three of the measures have fairly high predictive value for both 
veterans and nonveterans; these measures are the Cooperative 
Survey P'est of Mathematics, SAF-M, and the Converted School 
Grade. The six validity coefficients all fall between ,51 
and .53. 

The measures of verbal ability (SAT-V and Level of Com- 
prehension) both have low positive correlations with the 
criterion. 

Number of terms of mathematics previously studied is a factor 
which has little, if any, relation to success in Mathematics 103. 
For non veterans the correlation is —.03, while for veterans the 
correlation is .19. This variable also has essentially zero 
correlations with almost all of the predictors, including the 
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mathematics achievement test. Veterans were more variable 
with respect to amount of mathematics previously studied than 
were non veterans. 

The amount of time elapsing since high-school graduation is 
also unrelated to Mathematics 103 grade for veterans. 1 There 
is a slightly greater tendency for year of high-school graduation 
to bear a positive relation to measures of mathematics ability 
than to measures of verbal ability. (The comparable set of 
correlations was not computed for nonveterans because prac- 
tically all of the nonveterans were graduated in the same 
year.) 

The Mathematics 103 grades can be predicted slightly more 
accurately for nonveterans than for veterans, as is shown by the 
smaller standard errors of estimate. The unit, it will be re- 
called, is one-third of a group. The standard errors of estimate 
are therefore slightly greater than one group on the Princeton 
grading system. 

The corresponding table of intercorrelations for Mathematics 
101 is shown in Table 3. The correlations shown in Table 3 
are far less reliable, from a statistical standpoint, than those in 
Table 1 because of the smaller number of cases. It shows, how- 
ever, the same general tendencies as were apparent for Mathe- 
matics 103: the Survey Test, SAT-M, and CSG are among the 
best predictors; SAT-V has a low positive correlation with the 
criterion; and number of terms of mathematics previously 
studied has low predictive value. 

Two of the measures which proved to have high predictive 
value for Mathematics 103 are ordinarily available for 
Princeton students — SAT-M and CSG. It was found that the 
multiple correlation of these two variables with Mathematics 
103 grade (for nonveterans) was .63, which represents a con- 
siderable increase in accuracy of prediction over the variables 
used singly. 

As an aid to the use of SAT-M and CSG in actual prediction, 
an abac (Figure I) has been constructed which can be used for 
quickly finding the most probable Mathematics 103 grade for 


1 A similar result was obtained, in a study of veteran students at the University of 
Pennsylvania (i). 
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in Mathematics 103. The chances are about 1 out of 3, how- 
ever, that the actual grade received by a student will not differ 
from the predicted grade by more than one group. Two-thirds 
of the students who are predicted to have grades of a minus, for 
example, may be expected to make grades no higher than 1 mi- 
nus or no lower than 3 minus. The predictions obtained from 
the central part of the abac are more accurate than those ob- 
tained near the edges, 

In the event that SAT-M and CSG are not available, it is 
possible to give a student the Survey 'Test of Mathematics and 
thus obtain a fair prediction of success. 

Comparison of Veteran and Nonveteran Students With Respect 
to Achievement in Mathematics 

As may be seen from the means shown in Table 1, nonveteran 
students on the average made better grades in Mathematics 
103 than did veterans. This cannot be taken at face value as 
evidence that veterans are handicapped by their war service. 
Veterans have lower mean scores on every one of the variables 
except on the number of terms of mathematics previously 
studied. It is therefore entirely possible that the lower grades 
in Mathematics 103 may be accounted for by lower aptitude. 

The relationships between grades in Mathematics 103 and 
each of the three best predictors (SAT-M, the Survey Test, 
and CSG) are shown in Figures II, III, and IV. These figures 
show, for veteran and for nonveteran students, the regressions 
of Mathematics 103 grades on each of the three predictors in 
turn. The regression lines may be used for prediction. The 
heavy middle lines in each graph show what Mathematics 103 
grade will most probably be obtained by a student with any 
particular score on the predictive measure. The standard 
errors of estimate are shown by the lighter lines above and 
below the regression lines. 

It is apparent from Figures II, III, and IV that it makes little 
difference whether one is dealing with a veteran or a nonveteran ; 
the predictions will be practically the same. Judging from 
inspection of the three figures, one would say that veterans and 
nonveterans are alike: the standard errors of estimate are very 
similar, the slopes of the regression lines are practically the 
same, and data frqm both groups tend to fit the same regression 
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line. Whatever veteran-nonveteran differences exist seem to 
be predictable on the basis of aptitude and preparation. 

The regressions of Mathematics 103 grades on SAT-M, the 
Survey Test, and CSG, for veterans and for nonveterans, were 
studied by means of analysis of covariance techniques. The 
method used was one devised by S. S. Wilks (3), By this 
method, three hypotheses are tested: (1) the hypothesis that 
the standard errors of estimate are the same for the groups 



being studied (in this case, veterans and nonveterans) ; (a) 
the hypothesis that the slopes of the regression lines are the 
same; and (3) the hypothesis that the intercepts of the re- 
gression lines are the same, i.e., that the data from both groups 
fit one regression line. 

The result of the test of each hypothesis is expressed in terms 
of the probability (P) that the observed difference would have 
happened by chance. The results are shown in Table 4. 

The standard error of estimate of Mathematics 103 grades 
from SAT-M for veterans was 3.7 and for nonveterans, 3.5. 
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The probability that this difference might have occurred by 
chance is found to be .52. The two regression coefficients are, 
for veterans and nonveterans respectively, .03 and .04; the 
probability of a difference of this magnitude occurring by 
chance is found to be .18. The probability that the difference 
in intercepts of the regression lines might have occurred by 
chance is .21. Since this difference is well within the range of 
probability, it may be concluded that veterans and non- 
veterans do not differ in grades in Mathematics 103 when 
aptitude, as measured by the SAT-M, is taken into account. 

In the case of the Survey ‘Test in Mathematics , the standard 
errors of estimate are 3.8 and 3.5 for veterans and nonveterans 
respectively; the value of P is found to be .46. The regression 

TABLE 4 


Probabilities that Differences in Errors of Estimate , Slopes oj Regression Lines, and 
Intercepts Resulted /torn Chance Fluctuations 


Regression of Mathematics 

103 Gra.de Ont 

Hypothesis of 
Equality of 
Errors of 
Estimate 

P -Value 

Hypo thesis of 
Equality of 
Slopes 

Hypothesis of 
Equality of 
Intercepts 

SAT-M 

■ S 2 

.18 

.o,j 

Survey Test 

. 4.6 

99 

■'5 

CSG 

•43 

■99 

,60 


coefficients are almost identical; carried to four decimal places, 
they are .3188 and .3193. The P-value for the hypothesis of 
equality of slopes is .99. In the case of the hypothesis of 
equality of intercepts, the P is .15. Again the conclusion is 
that when allowance is made for differences in aptitude and 
preparation, there is no significant difference between veterans 
and nonveterans. 

The standard errors of estimate of Mathematics 103 grades 
from CSG were found again to be 3.8 and 3.5 for veterans and 
nonveterans; these values are not significantly different, as is 
shown by a P of .43. Again we find that the regression coef- 
ficients are almost identical (.9089 and .9072) and P equals 
.99. The hypothesis of equality of slopes is not disproved, the 
P being .60. 

The similarity in slopes of the regressions of Mathematics 
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103 grades on Survey Test scores and on CSG is of course far 
greater than one would expect on the basis of sampling theory. 
No explanation of this finding can be offered. 

The conclusion to be drawn from the analysis of covariance 
is that veteran and nonveteran students in the Mathematics 
103 course at Princeton are essentially alike; differences in 
achievement as measured by course grades are accountable in 
terms of differences in aptitude and preparation, This con- 
clusion holds for all three predictive measures. 

One of these predictive measures (the Survey Test) is based 
on testing done at the very beginning of the mathematics 
course; another (CSG) is based on school records which, in the 
case of the veterans, were earned on the average about three 
years prior to beginning the mathematics course; the third 
(SAT-M) was earned by veterans sometimes at about the time 
of high-school graduation and sometimes after war service (in 
the case of the SV test). The conclusion that, taking ability 
into account, there is no significant difference between veterans 
and nonveterans in mathematics achievement holds for 
measures obtained at the beginning of the course and also for 
measures obtained, in the case of veterans, several years prior 
to the beginning of the course. 

The corresponding regression lines for Mathematics 101 
grades are not shown, since the small number of cases makes 
the statistics unreliable. It may be stated, however, that the 
regression line for veterans is above the regression line for 
nonveterans in each of the three cases; knowing that astudent 
is a veteran would result in a slightly higher prediction of 
Mathematics 101 grade. The analysis of covariance was not 
applied in the case of the Mathematics 101 data because the 
technique assumes an N of at least 50. 

Summary 

The purposes of this study were (1) to develop local norms 
for the Cooperative Survey Test in Mathematics ; (2) to investi- 
gate the value of the Survey Test and other available measures 
of ability for predicting grades in Mathematics iox and 103; 
and (3) to study the relation of veteran-non veteran status to 
achievement in mathematics. 
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The Cooperative Survey Test in Mathematics was administered 
to beginning students in Mathematics 101 and 103 during the 
first week of the term. In addition to the Survey Test scores, 
the following data were obtained: 

SAT-V score 
SAT-M 

Converted School Grade 
Age 

Year of high-school graduation 

Number of terms of mathematics previously studied 

Veteran-nonveteran status 

Level of Comprehension score 

Final grade in Mathematics 101 or 103 

Complete data were obtained for an adequate number of 
veteran and nonveteran Mathematics 103 students. The 
number of cases for Mathematics 101 was too small to give 
statistically reliable results. 

A table was prepared for converting scaled scores on the 
Survey Test to percentile ranks based on Princeton students 
enrolled in Mathematics 101 and 103. 

The best predictors of success in mathematics are SAT-M, 
CSG, and the Survey Test Scores; the validity coefficients of 
all these variables, using Mathematics 103 grade as the 
criterion, ranged from .51 to .53. The prediction is improved 
by combining SAT-M and CSG (R = .63). Number of terms 
of mathematics previously studied had little predictive value. 

An abac was constructed which makes it possible to rapidly 
translate any combination of CSG and SAT-M to a predicted 
grade in Mathematics 103 without computation. 

Nonveteran students were superior to veterans in mean 
final grade in Mathematics 103. Study of the regressions of 
mathematics grades on the predictors shows, however, that the 
difference in achievement between veterans and nonveterans 
may be accounted for by differences in aptitude and prepara- 
tion. The application of Wilks’ method of analysis of covari- 
ance shows that the differences between standard errors of 
estimate, slopes of regression lines, and intercepts are all 
within the range of chance expectancy. 
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COUNSELING— AN EDUCATIONAL TECHNIQUE 1 

RALPH F. BERDIE 
University of Minnesota 

Traditionally, counselors have been concerned with 
students having problems. Insofar as all students have prob- 
lems, counselors have directed most of their efforts toward those 
students whose problems are expressed through behavioral 
manifestations of maladjustment./' Counselors have assigned 
to themselves the task of helping “individuals who are mal- 
adjusted, or perplexed, or failing or delinquent” (3). They 
have worked primarily “with students who do not respond ade- 
quately to standardized instruction” (5). 

Although recognizing and agreeing with the principles stated 
by Cowley, Prescott, Douglas, and Williamson, most counselors 
have failed to regard their function as other than a therapeutic 
one. Their general procedure is to diagnose a “problem,” 
or to allow the student to find it himself, and then to apply 
therapy, whether it be advice, suggestion, or non-direction. 
The counseling process centers around the concept of a problem, 
or, for the more sophisticated counselors, around the concept of 
a pattern of problems. 

Counselors are certainly aware of those students falling into 
Bordin’s (1) category of “no problem,” but when this diag- 
nosis is made, the customary procedure is to dismiss the student 
with the conclusion, sometimes stated to the student, that he 
does not need counseling, The counselor can and should as- 
sume a much broader role. 

The thesis of this paper is that the counseling provided by a 
well-trained, capable counselor is an educational technique 
which can benefit all students, If counseling is defined not as 

1 The points of view presented in this paper summarize discussions in which many 
staff members at the University of Minnesota have participated, however, the author 
accepts full responsibility for the statements here made, Most appreciation is due to 
Dean E, G, Williamson who has so succinctly raised many of the questions discussed 
here. 
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a therapy for students having difficulties but as an educational 
situation offering to all students opportunities for development, 
the part the counselor plays in our educational system becomes 
quite different from that played in the past (4), 

From the time a counselee enters the interviewing room, the 
counselor carefully observes his behavior, both verbal and 
otherwise, to identify possible problems and when such iden- 
tifications are made, to treat these problems. The counselee, 
however, can obtain more in the interview than the alleviation 
of psychological conflicts and these additional functions of the 
interview can be listed. 

1. The interview offers the counselee an opportunity for 
establishing a responsible relationship with a respected adult. 
The intimate contacts most students have are restricted to 
members of their family or to people in their own age groups 
and many college students have no more than casual contacts 
with other mature individuals. A counselor who is willing to 
discuss in a situation void of emotional tensions and pressures, 
a student’s political, religious, social or sexual beliefs, and who 
reacts to the student’s statements as an appreciative adult, 
can provide the student with an experience often obtained by 
young people out of school and working with adults but fre- 
quently not available to college students. 

1 . The counseling situation provides an opportunity for the 
student to feel that someone is interested in him as a person. 
This is particularly a problem in a large school where individual 
contacts between staff members and students may not be ex- 
tensive. Knowing that someone is available and willing to 
engage in a face-to-face conversation offers the student an ego 
satisfaction often difficult to obtain in many colleges. Assum- 
ing a need for affiliation (2), the counseling interview provides 
an opportunity for the student to gain both social experience 
and to obtain satisfaction of that need. 

3. The counseling situation offers the student an opportunity 
to recognize explicitly his goals and to verbalize the processes 
which resulted in their selection. Most students are working 
toward goals they have previously chosen. Frequently they 
have not defined realistically these goals; often they have not 
understood the means by which they selected these goals, and 
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usually they know little of the motivations underlying these 
selections. Although students need not be encouraged to en- 
gage in excessive introspection nor non-productive self-study, 
vdiey must be taught the need for understanding their own 
motives and those of others. By discussing those things for 
which students are working, and why they are doing this,^!ie 
counselor can assist the student in understanding his own per- 
sonal mechanisms and can help the student to evaluate his 
progress toward his goals. The definition of goals and the 
clarification of motives are two activities a counselor can 
engage in with any studenjL.. 

4. Every student must acquire certain skills and learn certain 
facts which are most effectively taught through the means of 
personal interviews. In certain areas, such as the field of 
occupations, general knowledge teachable in larger groups is 
desirable, but specialized knowledge, relevant to a single or 
only to a few students, is also necessary. This type of informa- 
tion can be taught most effectively by counselors. In group 
psychotherapy, individual therapy is a necessary adjunct. In 
group instruction, counseling instruction is frequently needed. 
This is particularly true where the subject matter of the course 
relates directly to the life of the student, as it does in courses on 
marriage and family life, mental hygiene, abnormal psychology, 
and vocational orientation. 

If the counselor attempts to perform these functions, along 
with his previously recognized ones of helping students solve 
problems, the techniques used in counseling and the attitudes of 
, the counselor toward counseling will have to be changed. More 
emphasis must be placed by the counselor on the personal re- 
lationship between counselee and counselor. The counselee 
also will have to perceive that the counselor is not interested in 
the problem but rather in the student and will have to accept 
the counselor not as a specialist who defines and helps solve 
problems but rather as a rational and feeling adult ready to 
enter into a constructive social-personal relationship with the 
student, 

When doing this type of counseling, the counselor will not 
have to refrain from talking about himself and can reveal his 
own attitudes and relate his own experiences. The student 
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will have to see the interview as a give-and-take situation where 
those exchanges characteristic of most effective social situa- 
tions prevail. The depth of emotional relationship involved in 
psychoanalytic transfer is neither necessary nor desired here, 
but the counselor must assume a personalized, affective role 
in the counseling situation. 

The goals of this type of counseling do not preclude the use 
of test data. In fact, until students become accustomed to this 
new educational role of the counselor, ‘tests can provide a con- 
venient and harmless means of establishing the desired relation- 
ship. In many schools, all entering freshmen, all juniors, or all 
the students falling into other categories are given one or more 
tests for purposes of classification, screening, obtaining norms, 
or research. Frequently the students tested are invited at the 
time of the examination to see a counselor to discuss the results 
of the tests. Many students who have problems accept these 
invitations and thus establish contact with a helpful counselor. 
Many other students who have no observable problem also 
accept the invitation, motivated by curiosity, a hidden problem 
or the need for talking with someone. What the counselor 
does with these latter students depends upon his view of the 
counseling situation. If he is a therapist only, and not an 
educator, he carefully observes the student for any problems, 
and finding none, describes the test scores and concludes the 
contact. If he is attempting to make a counseling interview 
of this contact, he accepts the interview as a normal social 
situation and works toward the goals already described. 

An example of the difficulty involved in orienting counselors - 
to this approach was recently observed at the University of 
Minnesota. A research project involving several hundred 
students required that they take the Mintiesota Multif haste 
Personality Inventory. As a “reward” for completing the in- 
ventory, the students were told that they could come to the 
Student Counseling Bureau and discuss the results with a 
counselor. When they came to the counselors requesting “an 
interpretation of the Mult,” many of the counselors were dis- 
concerted, particularly when none of the scores on the Multi- 
phasic reached a point two standard deviations or more beyond 
the mean. Only after realizing that the test scores served pri- 
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manly to allow a counseling contact, rather than to provide 
material for discussion in the interview, did these situations 
begin to assume the characteristics of counseling interviews. 

One thing has become apparent from studying this type of 
interview. The counselor cannot give to the student the entire 
responsibility for determining the direction of the interview. 
Leads, such as “What’s on your mind?” “What would you 
like to discuss?” etc., are not productive, particularly after 
the opening phase of the interview. The counselor must share 
with the student the responsibility for the conversation, help- 
ing in the selection of topics, asking questions which give direc- 
tion to the interview, and acting more as a participant than as 
a neutral listening post. 

The traditional techniques of counseling all have a place in 
these situations. Information giving, reflection of feeling, 
suggestion, interpretation, questioning — all can be used appro- 
priately. When the student maintains, quite legitimately, the 
attitude that he is not a problem, these techniques must be 
used with a careful hand. 

The implications of this educational role of the counselor are 
manifold. Obviously, the counseling program and the in- 
structional program must be closely coordinated. This has 
been the practice for several years in the General College of 
the University of Minneosta, where students in classes in voca- 
tional orientation and individual orientation have accepted their 
counselors in these described roles. More recently, the course, 
“Preparation for Marriage,” in the College of Science, Litera- 
ture and the Arts at Minnesota has made more extensive use 
of this relationship. Three of the instructors in this course, 
including the Chairman of the Family Life Sequence, hold 
appointments as one-half-time counselors in the Student 
Counseling Bureau. As part of the course work, students have 
one or more personal interviews with these instructors and 
these interviews are structured as counseling interviews. All 
data available to University counselors are in the hands of these 
instructors and instruction is individualized and personalized 
to the point where student and counselor are participating in 
a socially meaningful relationship. 

Counselors who are to assume these functions will perhaps 
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require training not now obtained by most counselors, Al- 
though they must be skilled diagnosticians and therapists, they 
must also be sound educators possessing well-thought-out 
educational philosophies and having a clear understanding of 
the educational problems of normal youth. Obviously, a 
greater number of better-qualified counselors than are now 
available will be needed if this function of the counselor is 
widely recognized. 

The hitherto accepted idea that counseling must occur in 
an office, preferably over a desk, must also be re-examined, 
Counselors may have to go where students are — to rallies, 
picnics, camps, and meetings, instead of waiting for students to 
come to their offices or to a counseling bureau. These counsel- 
1 ing offices themselves perhaps should be changed from typical 
offices to conversation-stimulating situations. An experiment 
of this sort is already under way where a comfortable inter- 
viewing room without a desk is in use and interviews conducted 
in this room are being compared to interviews conducted in the 
more traditional offices. 

Finally, if counselors are to assume this new role, they must 
create a nfcw stereotype of themselves to be held by educators 
and students. More of their discussion must concern the 
"normal" student, more of their concern directed toward the 
educational problems and dilemmas of society. Following this, 
counseling as an educational technique need not limit itself 
to the schools but, like all education, can enter into the com- 
munity. 

REFERENCES 

1. Bordin, E. S. "Diagnosis in Counseling and Psychotherapy.” 

Educational and Psychological Measurement , VI (1946), 109- 
184. 

2. Murray, H. A. et al. Explorations in Personality. New York: 

Oxford University Press, 1938. 

3. Rogers, C. R. Counseling and Psychotherapy. New York: 

Houghton-Mifflitu 1942, 

4. Williamson, E, G. “Counseling as a Fundamental Process in 

Education.” Schoolmen's Week Proceedings, University of 
Pennsylvania Bulletin, 33rd Joint Meeting, Southeastern 
Convention District of Pennsylvania State Education Asso- 
ciation, 1946, 1-7. 

3. Williamson, E. G. How to Counsel Students. New York: Mc- 
Graw-Hill Book Company, 1939. 



the dependence of factorial composition 

OF APTITUDE TESTS UPON POPULATION DIFFER- 
ENCES AMONG PILOT TRAINEES. II. THE FACTO- 
RIAL COMPOSITION OF TEST AND CRITERION 
VARIABLES 


FRANK J. DUDEK 
Northwestern University 

A previous report (i) was concerned with the isolation and 
identification of factors from a battery of tests {'The AAF 
November 1943 Classification Battery ) administered to three 
groups of pilot trainees representing different selective condi- 
tions. The three groups were: The Experimental group — 1012 
men admitted to pilot training without regard for scores in a 
qualification examination or for scores on the classification 
battery; The WASP group — 198 women in pilot training; and, 
a Restricted group — 1920 men selected for pilot trailing on a 
basis of a qualifying examination and their pilot aptitude scores. 
It was found that the selective conditions did not alter ma- 
terially the identification of factors obtained. The present 
study examines the factorial composition of the test and cri- 
terion variables more closely in an attempt to determine how, 
or if, the functions of these variables change appreciably from 
group to group. 

Factorial Composition of the Test V ariables 

It is possible to examine the factorial composition of the test 
variables directly from the factor loadings. However, it seems 
more meaningful to discuss the variables in terms of variance 
because variances can be summed and treated as numerical 
quantities. The variance is merely the square of the factor 
loading. 

The factorial composition of the tests is most easily appre- 
ciated if the variances are represented by simple charts depict- 
ing the proportion of each test’s variance accounted for by each 

n 
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FACTORIAL COMPOSITION OF TESTS COMPRISING THE 
>54.1 CLASSIFICATION BATTERY 
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FACTORIAL COMPOSITION OF TESTS COMPRISING THE AAF NOVEMBER 
1943 CLASSIFICATION BATTERY 


SYMBOLS: 
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FACTORIAL COMPOSITION OF TESTS COMPRISING THE AAFNOVEMBF 
1943 CLASSIFICATION BATTERY' 


SYMBOLS: 
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factor. The total variance of each test is assumed to be i.oo. 
The difference between the reliability of a test and unity is 
interpreted as error variance; while the difference between the 
communality (common factor variance) and the reliability is 
interpreted as specific or unique variance. Figure I shows, for 
each test and for each group, the variance attributable to each 
of the factors and to error and specific causes. 

The previous article reported factorial analyses for the three 
different samples. In the present variance charts a fourth esti- 
mate of test composition has been added and called "compos- 
ite.” This composite is an estimate derived from many 
factorial analyses of various batteries in which the present tests 
were included. (The factor loadings from which the variances 
were computed are reported in Guilford (a), Table 28 15). 
Because this composite is based on various analyses the factor 
loadings should be relatively stable. It should be pointed out 
that the groups on which the composite estimates are based 
were selected by a qualifying test and classification battery, 
and should be comparable to the group we have designated 
the Restricted group. 

Test reliabilities were not available for the particular groups 
studied here. However, estimates of error variance were based 
on reliabilities reported in the composite, or were determined 
from a sample of 1000 men (comparable to the Restricted 
group.) 1 For purposes of comparison it was assumed that the 
reliabilities of the tests were the same for all groups. Since 
the reliabilities reported were determined for restricted groups 
they should be conservative estimates. Because reliabilities 
were not actually computed for each group, the line of demarca- 
tion between specific and error variance has been indicated by 
a dotted line on the variance charts. 

The common factor variance of the biographical tests (tests 
1 & 1) is relatively low. Much variance is attributable to 
“error.” This may be interpreted as due to the fact that the 
reliability was based on internal consistency rather than on 
test-retest data. One should expect that the reliability of a 
test-retest would be almost perfect. Even so, the variance 

l The estimates of reliability were split-half reliabilities corrected by the Spearman- 
Brown prophecy formula. 



IOO EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT 


would be specific. The first test (Navigator score) seems pri- 
marily to be accounted /or by aviation interest and numerical 
factors (number or mathematics background). For the second 
test (Pilot score) the two factors which account for most vari- 
ance in various groups are aviation interest or mechanical 
experience factors. 

The Spatial Orientation "Test (test 3) shows a much more con- 
sistent picture. Over one-third of the total variance and over 
one-half of the common factor variance can be attributed to 
the same factor for all of the groups. Very little specific 
variance remains. Test 4 ( Spatial Orientation II) shows a 
similar composition, but less variance is accounted for by the 
perceptual factor and a good deal more is specific for each of 
the groups. 

Test 5 ( Reading Comprehension) is primarily verbal, with 
number coming in to different extents for various groups. 
Test 6 (Dial and liable Reading) is primarily perceptual speed 
and numerical in nature — but a good deal of its variance is 
attributable to at least one other factor in each of the groups. 
Test 7 (Mechanical Principles') is of interest. Its variance can 
be attributed, in the main, to the mechanical experience factor 
and either space or visualization for the mens’ samples. But 
for the WASP group no mechanical experience factor was 
isolated — and its variance is accounted for by the verbal fac- 
tor. At the same time this test has by far the largest specific 
and the smallest common factor variance for the WASP group. 
Tests 8 and 9 (Instrument Comprehension I & IT) are relatively 
complex factorially. Test 10 (General Information) seems pri- 
marily verbal and aviation interest or mechanical experience 
for the several groups. The mathematics tests (11 and 1 T) 
are predominantly accounted for by the number factor for all 
groups. 

The most striking aspects of the psychomotor tests (tests 
13—18) are the relative complexities and the great amounts of 
specificity. The “purest” of the psychomotor tests, by far, 
is the Rotary Pursuit Test (test 13). 

These data contain several implications for test practice and 
suggest numerous hypotheses for further study. Analyses such 
as those just reported suggest that it is possible to construct 
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tests which are relatively pure and which measure consistently 
no matter to what kind of sample they are applied. Thus, 
the Spatial Orientation ‘Test (test 3) is relatively pure from the 
standpoint that but one factor accounts for the major portion 
of its common factor variance. It is relatively consistent in 
its measurement of this factor from group to group. It would 
seem that in practice the attempt should be to develop test9 
with these two criteria in mind — that the tests be relatively 
pure or homogeneous, and that they be relatively consistent 
in their measurement from sample to sample. 

Also suggested is the hypothesis that different tests may be 
measuring different functions in the various groups. This 
result does not seem too surprising. It seems entirely con- 
ceivable, for example, that a test involving simple addition of 
two digits might be primarily numerical in nature for children; 
but for a group of mathematicians, where these performances 
may be almost automatic due to practice, the test might be a 
function of perceptual speed. The implication of this for 
testing, of course, is that the factorial composition of tests 
should be determined for the various groups or levels of ability 
with which the tests will be used. But, as indicated above, an 
attempt should be made to find tests that do measure factors 
consistently in various groups, 

In the mathematics tests, for example, the extent to which the 
tests measure the number factor differs somewhat. The 
WASP group, as indicated by their mean score, represented a 
higher level of ability than did the other two groups — and the 
tests seem to be more purely number for them. The WASP's 
also scored higher than did the other groups in the Spatial 
Orientation Test and the variance attributed to the perceptual 
speed factor is greatest for this group. It would seem, then, 
that the factor variance may in some way be related to the 
level of ability of the group, or possibly to the homogeneity 
of the group. With respect to the paper-and-pencil tests this 
is true to some extent, as the degree of specificity of a test is 
inversely related to the level of ability (as indicated by the 
mean scores). But for the apparatus tests (13-18) this is not 
true. Thus, the WASP’s were a much more homogeneous 
sample and scored much higher on the Rudder Control Tes, 
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than did the men, but the common factor variance of this test 
is lowest for the WASP group. The relationship between level 
of ability, group homogeneity, and factorial variance remains 
an important one for further investigation. 

The relatively small amounts of common factor variance in 
the apparatus tests is significant. Only one test {Two-hand 
Coordination, test 14) has all of its variance accounted for. 
This specificity is manifested even in the composite where 27 
factors had been isolated in the various analyses. It seems 
doubtful that the apparatus tests are truly specific to this ex- 
tent; but rather that there are many more factors common to 
these tests which remain to be isolated and identified To 
determine the nature of these factors and to devise relatively 
pure tests for them is, therefore, an important area for further 
research. 


Factorial Composition of the Criterion 

Factors accounting for the variance of the pilot criterion for 
each group are shown in Figure II. It is evident that the 
criterion is relatively complex for all groups. The common 
factor variance of the criterion, however, is about the same for 
all groups; but it is very differently constituted for each of them. 
For the WASP group, which is probably the most homogeneous 
sample, it is accounted for by only four of the factors isolated. 
In the Experimental group, on the other hand, every factor 
isolated accounts for at least some small portion of the criterion 
variance. For the Restricted group numerous factors account 
for the criterion. 

It seems reasonable that the relative importance of factors 
might change somewhat depending upon the previous selection 
of the group. Thus for a homogeneous group such as the 
WASP’s different factors are important than for the unselected 
Experimental group. For the unselected group all factors are 
of at least some value in predicting the criterion. This is 
reflected also when beta weights are computed for the different 
tests to determine the multiple regression equation which pre- 
dicts the criterion optimally. For the Experimental group no 
test has a significant negative weight. For the WASP group, 
on the other hand, significant negative weights are assumed by 
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the tests that have most variance accounted for by the numeri- 
cal and psychomotor factors. This again has implications for 
test practice. A test battery of maximum predictive value 
could be developed a priori if the factorial composition of the 
tests and of the criterion were known. If relatively pure factor 
tests were available and the factorial composition of a criterion 


FACTORIAL COMPOSITION OF 
THE PILOT CRITERION 



were known one could estimate fairly accurately the validity of 
the selective procedure without awaiting “validation data.” 

Summary and Conclusions 

The factorial composition of tests included in the AAF 
November 1943 Classification Battery was examined for groups of 
subjects representing different selective conditions. The re- 
sults are pertinent to test practice and contain suggestions for 
future research. 

1. In different samples tests vary in (a) the consistency with 
which they measure different factors and, (b) the extent to 
which they are “loaded” with a given factor. There is some 
evidence that the tests which are purest are also the most con- 
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sistent. These results emphasize the importance of developing 
tests that are factorially pure, i.e., tests which measure a par- 
ticular factor exclusively rather than a great number of factors. 
Previous investigations along factorial lines have yielded 
significant information as to the nature of factors. Eventually 
there should be no ambiguity as to the functions measured by 
different tests, and it would seem that efforts might well be 
directed toward constructing tests which will act as consistent 
measuring devices with known properties in various contexts. 

a. Psychomotor tests on the whole seem to have a greater 
degree of specificity, i.e., lower common factor variance, than 
do paper-and-pencil tests. They also tend to be less pure than 
some of the paper-and-pencil tests. Important areas for 
further research are the isolation of further common factors 
which presumably will be found within what is now recorded 
as specific variance in apparatus tests, and the devising of 
relatively pure measures of these factors. 

3. It was shown that the factorial description of the criterion 
varied from sample to sample. This result calls attention to 
the importance of considering the factorial composition of 
criteria in general, as well as of tests. A battery of tests vali- 
dated for one group often does not retain the same validity 
when applied to another group, and it is apparent that knowl- 
edge of the factorial composition of tests and criteria should 
make more meaningful the relationships among them. 
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SOME TRENDS IN THE DEVELOPMENT OF 
PSYCHOLOGICAL TESTS 


ASAHEL D. WOODRUFF and MARALYN W PRITCHARD 
Cornell University 

Psychological tests have become so numerous in recent 
years that it is difficult to keep informed about new tests or 
revisions of old tests. The problem is complicated by nu- 
merous sources of publication which are not adequately 
represented by any of the catalogues issued by distributors. 
The problem may not be as acute for centers which use tests 
for diagnosis and measurement, as for those which attempt to 
provide instructional service for graduate students in depart- 
ments of psychology or in schools of education. 

The Cornell University Testing Service, in conjunction with 
the Bureau of Educational Research and Service of the School 
of Education, began in January, 1947, to set up a test library 
which could be used both for instructional purposes and for 
actual testing in connection with the personnel services of the 
University. A very thorough search of all available catalogues, 
and a continuous search for tests which are not readily found 
through catalogues but which are available for use, has re- 
sulted in the establishment of a library, some of whose features 
may be of interest to others. 

Since test publishers and distributors are not uniform in 
their test categories, the first requirement was the development 
of a classification system into which all sorts of tests could be 
fitted. A decimal system of numbering was used to allow for 
indefinite expansion throughout the system. In September, 
1948, a complete index for the library was mimeographed for 
use on the campus. It contains 1080 tests, practically all of 
which are now available on the market. These tests are pub- 
lished by 74 publishers, who are listed at the end of the index. 
Each test is coded to show who publishes it, so the psychome- 
trist can locate it quickly in a catalogue, or place an order with- 
out having to hunt up the test or find a listing in a catalogue, 
although publishers do not always distribute their own tests. 
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The extent of the index may be visualized by the fact that it 
fills 28 pages of eight by ten paper, with single-spaced entries, 
one line to each test. Following is an outline of the index, 
showing the number of tests available in each of the various 


categories. 

Outline of Test List 
A. Achievement Tests 

1. General 

1. 1 Grades 1-9 36 

1 .1 High Schools and Colleges 13 

2. Reading 

a. 1 Grades 1-12 90 

a .2 High Schools and Colleges 17 

3. Mathematics 

3.1 Diagnostic Tests in Arithmetic 23 

3.2 General Achievement Tests in Arithmetic 33 

3.3 General Achievement Tests in Mathematics 13 

3.4 Plane Geometry 15 

3.5; Solid Geometry 5 

3.6 Trigonometry 4 

3 7 Analytical Geometry 1 

3.8 Industrial Mathematics a 

3.9 Elementary Algebra 18 

3.10 Intermediate Algebra 2 

3.U Advanced Algebra I 

3.12 Calculus 2 

4. Science 

4.1 General 18 

4.2 Zoology 1 

4.3 Chemistry 18 

4.4 Biology 10 

4.5 Physics 11 

4.6 Geology > 2 

4.7 Botony 1 

4.8 Astronomy 1 

4.9 Meteorology 1 

4.10 Agriculture 2 

5. Languages 

5.0 General Languages 2 

5.1 Latin 19 

5.2 Spanish 12 

5.3 Italian 3 

5.4 German 9 

5.5 French 20 

6. English 

6.1 Grades i-x 2 47 

6.2 High Schools and Colleges 35 

7. Spelling 23 

8 . Vocabulary ao 

9. Grammar 3 
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10. History 

10.1 General j 

10.2 American ai 

10.3 Modern European 4 

10.4 Ancient j 

10.5 World $ 

11. Social Studies 37 

m. Geography 10 

13. Handwriting n 

14. Health 13 

15. Home Economics 12 

16. Aeronautics 4 

17. Commerce 33 

18. Library Information 4 

19. Psychology 3 

ao. Engineering 16 

21. Journalism 1 

22. Automobile Driving 1 

B. Attitudes 

C. Aptitudes 

0. General Battery 2 

1. Practical Judgment 7 

2. Science 3 

3. Mechanical 

3.1 Pen and Paper 25 

3.2 Manual 8 

4. Clerical 14 

5- Sales 3 

6. Stenography and Typing 3 

7. VisualTests 2 

8. Art 6 

9. Music 11 

10. Nursing 6 

11. Supervisory i 

12. Vocational 2 

13. Medicine 1 

14. Educational 8 

15. Law 1 

16. Religion 1 

D. Intelligence 

1. General Mental Ability 96 

2. Primary Mental Ability 5 

E. Interests 

1. General 4 

2. Vocational 17 

3. Academic _ 2 

F. Personality and Adjustment 60 

G. Values 7 

H. Rating Scales 10 

I. Personal Selection 

1. College 7 

2. General (See specific areas) 
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t Critical Thinking 7 

. Pre-school Readiness Tests 13 

L. Study Skills j 

M. Status Information 7 

N. Concepts I 


For instructional purposes, a complete specimen set of each 
test is sufficient in most cases, although it is often desirable to 
put copies of a test in the hands of each member of a class when 
the test is being analyzed. That is ordinarily possible, how- 
ever, for the tests which are usually studied most carefully at 
Cornell are those which are also being used in the personnel 
services, with few exceptions. To allow sufficient scope for such 
individual testing as is required in a full personnel service, 
where personal, educational, and vocational counseling are 
involved, it has been found helpful at Cornell to maintain some 
159 of these tests in fairly generous quantities. To assist 
counselors on the campus, those tests are starred in the index 
which is furnished them. Some of the needs which give rise 
to this rather sizable stock of active tests arise from diagnostic 
services extended by the Bureau of Educational Research and 
Service to public schools and to private individuals, from re- 
search programs in the School of Education, and from the 
University’s annual Freshman testing program in September. 

To one interested in trends in test development the fre- 
quencies shown in the outline are significant. The great bulk 
of tests are for measuring achievement, with greatest numerical 
strength in the field of reading. English is well served. 
Mathematics is well served in the grades below the twelfth, but 
not above that point. There is a large supply of general 
intelligence tests of the paper and pencil type, for group ad- 
ministration. The field of personality measurement is also 
numerically well supplied. Among aptitude tests, mechanical, 
clerical and musical tests are far more plentiful than most of 
the others. 

Obviously this report does not deal with the quality of the 
tests listed. Anyone familiar with Buros’ Yearbooks will ap- 
preciate the problems involved in criticism. Nevertheless the 
picture presented here may be helpful to those interested in 
psychometrics, as an indication of the scope and trends of the 
area. 



A NOTE ON THE CORRELATION BETWEEN A 
CONTINUOUS VARIATE AND A DISCRETE 
DISTRIBUTION 


E. H. HSt) 

Catholic University of America 

In' psychometric data sometimes one desires to know the 
correlation between a quantitative continuous variate and a 
discrete series. The former may be, say, a system of personal- 
ity inventory scores and the latter, the number of children of 
each of a group of families. The discrete series is of such 
nature that its values can take only whole numbers. In such 
cases it seems best to assume a Poisson series rather than a 
Gauss series. A review of the available statistical textbooks, 
however, does not disclose an appropriate method to treat such 
a correlation. It seems thus desirable to derive some formulae 
corrected for the Poissonean assumption. Let the following 
equation represent a Poisson variance: 

trl = M v (x) 

Each measure of the distributions may be conceived of as a 
deviate from an ideal score, or the mean. Then the difference 
between the two deviates may be indicated as 

dq _ p = dq dp 

Squaring the above equation, summing for all measures and 
dividing by the number of samples, we get 


ffqlp — CTq 2 r qp<7q<7p "L &V 

By the aid of (i), we may write the correlation between the 
quantitative variate and the discrete distribution as follows: 







where M p stands for mean of the discrete series. It should be 
noted that this formula is correct only when linearity can be 
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assumed in the correlation. For a non-linear function, the cor- 
relation does not seem to admit a direct solution. If one can 
reasonably assume the homoscedasticity in the data, one may 
use the following formula for the columnar variance: 

<rl 3=8 M'p-A'fpt' 

Transposing and using the average <r t ’s as a compromise to the 
demand of strict homoscedasticity, one may write the following 
equation approximating to 

/ ^ 

" V * - 1 (3) 

Great precaution should be taken when equation (3) is used. 
It is of extreme importance that the distribution is proven to be 
Poissoinean, by testing the following expectancy: 



If such test as chi-squares confirms the agreement between the 
observed and expected values, then equation (3) perhaps can be 
very serviceable for obtaining the correlation from data of 
such nature. 



NEW TESTS* 

Aptitude Test for Elementary School Teachers , by Henry Bowers. 
This test is designed to determine points of view with regard 
to a number of situations; opinions, books, occupations, in- 
terests, and judgment. It also contains a performance test 
which is essentially a concealed interview in which the examiner 
rates the student on several personal qualities. Range: ele- 
mentary-school teacher trainees. No time limit. Price: Teach- 
ers’ Manual and package of 25 tests, $3.50. Published by J. M. 
Dent and Sons (Canada), Limited, Toronto, Ont. 


Army General Classification Test ( Civilian Edition). Three types 
of problems are presented: vocabulary, arithmetic word problems 
and block counting Range: high school, college and adult 
Working time: 40 minutes. Price: Form AH, handscored: 
reusable test booklets with answer pad, each 48^; answer pads, 
package of 25, $1.65 Form AM, machine-scored: reusable 
test booklets, each 38^, answer sheets, package of 100, $ 1 90. 
Published by Science Research Associates. 


Cooperative Achievement Tests , i9/f.8, Form Y. Two prices are given 
after the description of each of the following tests The first 
is the price of 25 test booklets; the second is the price of 25 
answer sheets. 

Elementary Algebra Test ( Revised Series), by Robert S Lankton, 
el al. Designed to test the basic skills and principles included 
in the typical elementary algebra course (extending through 
quadratics). Range: high-school classes in elementary algebra. 
Working time: 40 minutes. $2.25; 8ofi. 

Intermediate Algebra Test ( Revised Series ), by M. Isobel Blyth, 
et al. Covers the materials included in the typical second course 
in algebra (quadratics and beyond). Range: high-school 
classes in intermediate algebra. Working time: 40 minutes. 
$2.25; 8ojh 

American Government Test ( Revised Series), by John Haefner. 
Graphic and verbal material for the purpose of measuring 
understanding of concepts developed in courses. Range: high- 
school classes. Working time: 40 minutes. $2.50, 80^ 


* Addresses of the publishers of the tests listed are given at the end of the sec - 
tion, The prices given are for the smallest package listed by the publishers, In 
some instances, certain details are not included because they were not available at 
the time of going to press 
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American History Test {Revised Series'), by Harry D. Berg. 
Designed for measurement of understanding and information 
of materials presented in secondary-school or elementary-college 
courses in American History. Range: high-school and ele- 
mentary-college courses in American history. Working time: 
40 minutes. $2.25, 8o(i. 

Biology Test (Revised Series), by Paul E. Kambly, et a/. In- 
tended primarily to investigate student’s factual knowledge, 
Range: high-school classes in biology. Working time: 40 
minutes. $2.50, 8o(4. 

Chemistry Test ( Revised Series), by Joseph F. Castka, et al, 
Planned to test fundamental facts and principles. Range: 
high-school classes in chemistry. Working time: 40 minutes. 
$2.25, 8o£. 

General Chemistry Test , {Form 1948), by Cooperative Test 
Service and The American Chemical Society. Covers general 
knowledge and information in the field, application of principles, 
scientific method, and laboratory technique. Range: elemen- 
tary-college chemistry classes. Working time: no minutes. 
$2,50, 8o£ 

Chemistry Test In Qftalitalive Analysis {Form Y), by Cooperative 
Test Service and The American Chemical Society. Topics 
covered are (1) application of the laws of solution; (a) equations 
of typical analytical reactions; (3) numerical problems dealing 
with solubility product, ionization constant, pH and common- 
ion effect. Range: college classes in qualitative analysis. Work- 
ing time: 60 minutes. $2.00, 8o£. 

Chemistry Test in Qj-iantitatke Analysis, by Cooperative Test 
Service and The American Chemical Society. Covers “theo- 
retical principles ... in volumetric or gravimetric procedures 
in an elementary course . , .” Range: college classes in quan- 
titative analysis. Working time: no minutes. $2.50, 8ojh 

Organic Chemistry Test ( Revised , 1948), by Cooperative Test 
Service and The American Chemical Society. Intended to 
provide a measure of achievement for use in college classes in 
organic chemistry. Range: college classes in organic chemistry. 
Working time: 100 minutes. $2,50, 80^. 

Contemporary Affairs for College Students, {Form 1048), by E. F. 
Lindquist, Robert L. Ebel, John Haefner, Wendell Smith, et al. 
Three parts: public Affairs; sciences and medicine; literature and 
fine arts. Range: college classes. Working time: 80 minutes. 
$2.50, 8a?!. 

Modern European History Test {Revised Series), by Frederick 
H. Stutz, et al. The questions call for information and under- 
standing of material from beginning of Renaissance to the present. 
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Range: high-school and. college classes. Working time: two 
hours. $2.50, 8oji. 

Foods and Nutrition , by Cooperative Test Service and the 
Evaluation Committee of the American Home Economics Asso- 
ciation. A test designed to measure pre-professional informa- 
tion, knowledge of methods and operations in areas relating to 
home economics and nutrition. Range: pre-professional college 
classes. Working time: 80 minutes. $2.50, 90fi. 

General Achievement Tests ( Revised Series): 

Mathematics, by Bernice Orshansky, et al. 

Social Studies, by Elaine Forsyth, et al. 

Natural Sciences, by Carl A. Pearson, et al. 

Three separate tests. Each test consists of two parts: terms 
and concepts, and comprehension and interpretation. Range: 
Grades 10 through 12. and entering college freshmen. Working 
time: 40 minutes (each test). $2.50, 80^ (each test). 

Plane Geometry Test ( Revised Series), by H. Vernon Price, et al. 
Designed to measure the fundamentals of a first course in geom- 
etry. Range: high-school classes in plane geometry. Working 
time: 40 minutes. $2.25, 8oj!. 

Latin Test ( Lower Level), by Harold V. King. Three parts: 
comprehension, grammar, and civilization. Range: students 
in tne first two years of nigh school or the first year of college 
Latin, Working time: 80 minutes, $2,50, 90^. 

Latin Test ( Higher Level), by Harold V. King. Three parts: 
comprehension, grammar, and civilization. Range: students 
with more than two years high-school Latin, or more than one 
year college. Working time: 80 minutes. $2.50, 90^. 

Mathematics Test for Grades 7, 8, 9, by Bernice Orshansky, et al. 
Four parts labeled: Skills; Facts, Terms, and Concepts; Applica- 
tions; and Appreciation are included. Range: Grades 7, 8, 9. 
Working time: 80 minutes. $2.50, 8ojl. 


Mathematics Pre-Test for College Students, by the Committee on 
Tests of the Mathematical Association of America, et al. In- 
tended to offer a sampling of high-school mathematics abilities. 
Range: Pre-test for beginning college mathematics courses. 
Working time: 40 minutes. $2.00, 8ojl. 

Physics Test ( Revised Series), by Paul J. Burke, et al. An 
achievement test for a secondary-school physics course. Range: 
high-school classes in physics. Working time: 40 minutes. 
$2.2$, 8ofS. 


Test On Recent Social and ScientiJ 
by E. F. Lindquist, Robert L. I _ _ 

Smith, et al. The test is "Designed to measure the degree to 


c . Developments ( Form 1948 ), 
,bel, John Haefner, Wendell 
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which the student is making sound, and critical observations 
about recent changes and developments in our contemporary 
civilization, and how well he recognizes their underlying sig- 
nificance.” Range: Grades 9 through 12. Working time: 80 
minutes. Price: iOfi per pupil (including booklet and answer 
sheet). Minimum order $5.00, Specimen set ioj 5 . 

Science Test for Grades 7, 8 , 9 , by Paul E. Kambly, et al. Knowl- 
edge of principles and functioning of common mechanical de- 
vices as well as natural phenomena is called for here. Range: 
Grades 7, 8, 9. Working time: 80 minutes. §2.50, 8oj!. 

General Science Test {Revised Series), by Paul E. Kambly, et al. 
Directed at the measurement of information and understanding. 
Range: high-school classes in general science. Working time: 
40 minutes. $2.25, 8ofl. 

Social Studies Test for Grades 7, 8 , 9 , by Eunice Ann Lloyd, et al. 
Content includes items relating to economic, social, physical 
and historical factors in the development of the American nation. 
Range: Grades 7, 8, 9. Working time: 80 minutes. $2.50, 80^. 

Spanish Test {Lower Level), by William H. Shoemaker and 
Geraldine Spaulding, el al. Three parts: comprehension, gram- 
mar and civilization. Range: students in the first two years 
of high school or the first year of college Spanish. Working 
time: 80 minutes. $2.50, 90^. 

Spanish Test {Higher Level), by William H, Shoemaker and Ger- 
aldine Spaulding, et al. Three parts: comprehension, grammar, 
and civilization. Range: students with more than two years 
of Spanish in high school or more than one year in college. 
Working time: 80 minutes. $2,50, 90ft. 

Test in Textiles and Clothing, by the Cooperative Test Service 
and the Evaluation Committee of the American Home Eco- 
nomics Association. Covers materials generally taught In 
college classes preceding professional work, such as garment 
construction, care and repair of clothing, selection and use of 
equipment. Range: pre-professional college classes. Working 
time: 90 minutes. $2.50, 90^. 

Plane Trigonometry Test {Revised Series), by John A. Long and 
L. P. Siceloff, et al. Range: high-school and college classes in 
plane trigonometry. Working time: 40 minutes. $2.25, 8oj!. 

Vocabulary Test, by Jeanne M. Bradford, Herbert Danzer, 
Geraldine Spaulding, et al. Comprises 210 multiple-choice 
items arranged in 7 repeating scales of equal difficulty. Range: 
Grades 7 through 12 and college classes. Working time: 30 
minutes is suggested. $2.25, 90^. 

World History Test {Revised Series ), by William Taylor, et al. 
“This test covers the entire period from prehistoric times up 
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through the present.” Range: high-school classes 
history. Working time: 40 minutes. $2.25, 8ofh 

English Tests: 

Mechanics of Expression , by Geraldine Spaulding and W. W. 
Cook, et al. An English test designed to cover usage, punctua- 
tion, capitalization, and spelling. Range: Grades 7 through 11 
and college classes. Working time: 40 minutes $2.25, 80^, 

Effectiveness oj Expression (Higher Level), by Janet Afflerbach, 
Miriam M. Bryan, and Geraldine Spaulding, et al. A measure 
of effective use of English, including sentence structure, and 
style; active vocabulary; and organization. Range: superior 
eleventh- and twelfth-grade students and college students. 
Working time: 40 minutes. $2.15, 8opL 

Effectiveness of Expression ( Lower Level), by Janet Afflerbach 
Miriam M. Bryan. Geraldine Spaulding, el al. Measures 
effective use of English including sentence structure and style 
active vocabulary, and organization. Range: Grades 7 through 
ri, college classes. Working time: 40 minutes. $2.15, 8oji. 

Reading Comprehension Test ( Higher Level), by Frederick B. 
Davis, Clarence Derrick, Jeanne M. Bradford, Geraldine Spauld- 
ing, et al. Covers recognition vocabulary, and reading; speed 
and level of comprehension. Range: superior eleventh- and 
twelfth-grade students; college students. Working time: 40 
minutes. $2.50, 8ojh 

Reading Comprehension Test ( Lower Level), by Frederick B* 
Davis, Clarence Derrick, Harry R. Neville, Jeanne M, Brad- 
ford, Geraldine Spaulding, et al. Covers recognition vocabulary, 
and reading; speed and level of comprehension. Range: Grades 
7 through 12. Working time: 40 minutes. $2.50, 8ofb 

Reading Comprehension and Effectiveness of Expression and 
Mechanics of Expression Tests are published in a single booklet 
edition for both the higher and lower level. $3.90, $1.70. 

American Council on Education Psychological Examination for 
High School Students, 1948 Edition, by L. L. Thurstone and 
Thelma Gwinn Thurstone. Price: Test booklets, per package 
of 25, $2,50. Answer sheets, per package of 25, 90;!. 

American Council on Education Psychological Examination for 
College Freshmen, 1948 Edition, by L. L. Thurstone and Thelma 
Gwinn Thurstone. Price: Test booklets, per package of 25, 
$2.50, Answer sheets, per package of 25, 90|4. 


Design Judgment Test, by Maitland Graves. A self-administering 
test devised to measure certain components of aptitude for the 
appreciation of production of art students. Working Time: 
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ao to 30 minutes (no time limit^, Hand or machine scored. 
Published by The Psychological Corporation. 


Diagnostic Reading Tests, by Committee on Diagnostic Reading 
Tests. This battery has been developed to ascertain reading 
skills from Grade 7 through first-year college. Currently avail- 
able in addition to tests listed in the 1948 “New Tests” section: 

Survey Section, Form A, including tests of rate of reading, vocab" 
ulary and comprehension. Working time: 40 minutes, isjiper 
booklet; answer sheets, 2jd each; specimen set and accessories, 35^ 

Section IV, Word Attack, Form A and B. Part 1 — Oral: 18^ 
per booklet and answer sheets. Booklet may be reused. Part 
2 — Silent: 1 iff per booklet; answer sheets, 2^ each. Published 
by the Committee on Diagnostic Reading Tests. 


Factored Aptitude Series of Business and Industrial Tests, by Dr. 
Joseph E. King. Consists of fourteen tests which have been 
developed to provide programs of aptitude measurement. Price 
per package of 50 individual tests is $3.75 (including handbook 
and answer stencil). Individual tests are described as follows: 
Office Terms Test, Mechanical Terms Test, Sales Terms Test, 
Scientific Terms Test, and Tools Test all are designed to measure 
comprehension factor plus interest in the specific field. Judg- 
ment Test and Differences Test measure reasoning factor, ability 
to deal with relationships, solve problems, etc. Numbers Test 
measures number factor, ability to deal with symbol system, etc. 
Perception Test and Precision Test measure Perception factor, 
ability to scan and locate details quickly. Fluency Test meas- 
ures flow or use of words with ease. Memory Test measures 
ability to recognize and recall associations. Dimension Test 
measures ability to deal with sizes, shapes and relations of 
objects in two and three dimensions. Motor Test measures 
coordination. (Motor testing equipment is priced at $15.00) 
Test Programs (combinations of tests for the job families): 
Clerical (Perception, Office Terms, Numbers); Sales (Sales 
Terms, Fluency, Memory); Scientific-Technical (Judgment, 
Office Terms, Numbers). Each of the above Programs are 
priced at $10.00 per package of 50 programs. Mechanical 
(Dimensions, Tools, Precision, Motor); Office Adm-Supervisory 
(Judgment, Office Terms, Perception, Fluency); Factory Adm- 
Supervisory (Differences, Mechanical Terms, Precision, Dimen- 
sions). Each of the three above Programs are priced at $13.00 
per package of 50 programs. Published by Industrial Psy- 
chology. 


How Supervise f Forms A, B, and M, by Quentin W. File and H. 
H. Remmers, 1^48, A measure of the knowledge and insight 
of supervisors in industry. Hand-scored. Price: package of 
25 tests, $1.75. Published by the Psychological Corporation. 



Illinois Inventory of Pupil Opinion, by Harold C. Hand, Gilbert C. 
Finlay and Ardwin J. Dolio, 1948. For Grades 7-12. An un- 
signed point scale questionnaire which reflects pupils’ opinions 
of teaching; methods, personnel and other factors related to their 
school environment. Available in sets of 25. Price: $1.30 per 
package of 25 test booklets. Handbook, What People Think 
about their Schools , $2.52. Published by The World Book 
Company. 


Illinois Inventory of Parent Opinion, by Harold C, Hand, Gilbert 
C. Finlay and Ardwin J. Dolio, 1948. An unsigned point- 
scale questionnaire which reflects parents’ opinions of the factors 
in the school environment which affect their children. Price: 
$1.60 per package of 25 test booklets. Handbook, $2.52. Pub- 
lished by The World Book Company. 


Iowa Language Abilities Test , Forms A, B, and C, by H. A. Greene 
and H. L. Ballenger, 1948. The elementary test consists of 
five parts: spelling, word, meaning, language usage, capitaliza- 
tion, and punctuation for grade range 4-7. The intermediate 
test is a seven-part test including five subtests in the areas 
listed above plus grammatical form recognition and sentence 
sense for grade range 7-10. Hand-scoring stencils for both 
levels. Working time for each level: 4 5750 minutes. Also 
available as Forms Am, Bm, and Cm with machine-scored 
answer sheets. Price per package of 25: Form A (elementary), 
$1.80, Form A (intermediate), $2.40. Form Am (elementary), 
$2.30, Form Am (intermediate), $2.80. Published by The 
World Book Company. 


Iowa Silent Reading Tests, New Edition Elementary Tests: Forms Cm 
and Dm, by H. A. Greene and V. H. Kelley, 1948. The six 
subtests are comprehension, directed reading, word meaning, 
paragraph comprehension, sentence meaning, and location of 
information. Grade range, 4-8. Time: one hour. Hand or 
machine-scored. Price: Si .70 per package of 25. Published 
by The World Book Company. 


Kuder Preference Record — Personal , ( Form A), by G. Frederic Kuder. 
Consists of a new series of preference scales intended as a sup- 
plement to the Kuder Preference Record — Vocational. This test 
measures preferences in five general areas of interest and per- 
sonality. Scales are: (A) preference for taking the lead and 
being in the center of activities involving people; (B) preference 
for dealing with practical problems and everyday affairs rather 
than interest in imaginary or glamorous activities; (C) preference 
for thinking, philosophizing, and speculating; (D) preference for 
pleasant and smooth personal relations which are free from 
conflict; (E) preference for activities involving the use of author- 
ity and power. Range: high school, college, adult. Working 
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time: about 40 minutes (no time limit). Prices: Form AH 
hand-scored: reusable record booklet with answer pad, each 48^’ 
answer pads, package of 2.5, Si.oo. Form AM, machine-scored': 
reusable record booklet, each answer sheets, package of 100 
$2.90. Profile sheets, package of 25, Published by Science 

Research Associates. 


Kuder Preference Record--— Vocational ( Form Br-shcrt form), by G. 
Frederic Kuder. This form has been developed for use in 
industrial situations where it is not practical to give the longer 
form (BB). It is designed to measure nine fundamental areas 
of educational and vocational interest: mechanical, computa- 
tional, scientific, persuasive, artistic, literary, musical, social 
service, and clerical. Range: high school, college, adult. Work- 
ing time: approximately one-half hour. Prices: Form BIH, 
hand-scored: reusable record booklet with answer pad, each 4.8^-, 
answer pads, package of 25, $2.00. Form BIM, machine- 
scored: reusable record booklet, each 38^; answer sheets, package 
of too, $2.90. Profile sheets, package of 25, Published 

by Science Research Associates. 


Kuder Preference Record — Vocational ( Form C — eleven scale), by G. 
Frederic Kuder. Designed to yield two new scores in addition 
to those obtained on Form B. One of these, Scale O, is the 
outdoor scale, which measures expressed preferences for out- 
door, naturalistic, and agricultural activities. The other, Scale 
V, is a Verification Scale intended to help identify those who 
have not followed directions or who have answered carelessly. 
The occupational areas in which scores are now obtainable are 
as follows: outdoor, mechanical, computational, scientific, per- 
suasive. artistic, literary, musical, social service, clerical, and the 
eleventh scale — the verification score. Range: high school, 
college, adult. Working time; about 40 minutes (no time limit). 
Prices: Form CH, hand-scored ; reusable record booklet with 
answer pad, each 48 ^ ; answer pads, package of 25, $a.oo. Form 
CM, machine-scored, reusable record booklet, each 38 ; answer 
sheets, package of 100, $2.90, Profile sheets, package of 25, 
Published by Science Research Associates. 


Metropolitan Achievement Tests, Forms R, S, T, and 17 , 1948, by 
Gertrude H. Hildreth, Richard D. Allen, et al. Batteries for 
five levels. 

Primary I Battery: For Grade 1. Four subtests are Reading — 
Word Pictures; Reading — Word Recognition; Reading — Word 
Meaning; and Numbers. Working time: 45 minutes. Price: 
.65 per package of 25. 

Primary II Battery: For Grade 2. Five subtests are Reading, 
Word Meaning, Arithmetic Fundamentals, Arithmetic Prob- 
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lems, and Spelling. Working time: 85 minutes. Price: $1.85 
per package of 25. 

Elementary Battery: For Grades 3 and 4. Six subtests are 
Reading, Vocabulary, Arithmetic Fundamentals, Arithmetic 
Problems, Language Usage, and Spelling. Working time: 135 
minutes. Price $2.45 per package of 2.5. 

Intermediate Battery: For Grades 5, 6, and beginning 7. Ten 
subtests are Reading; Vocabulary; Arithmetic Fundamentals; 
Arithmetic Problems; English; Literature; Social Studies: His- 
tory and Civics; Social Studies: Geography; Science; and Spell- 
ing. Time: four sittings of 45, 85, 45, and 65 minutes. Price: 
$2.75 per package of 25. 

Advanced Battery: For Grades 7, 8, and beginning 9. Subtests 
as listed for Intermediate Battery. Time: four sittings of 45, 
85. 55, and 65 minutes. Price $2.75 per package of 25. Pub- 
lished by The World Book Company. 

Minnesota Paper Form Board Test, Revised, Series AA, BB, MA, and 
MB, by R. Likert and William H. Quasha. Measure of ability 
to perceive spatial relations Hand-scored (all forms) or ma- 
chine-scored (form MA and MB). Time limit: 20 minutes. In 
the revision, directions and scoring are simplified, alternate 
series are equivalent, practice problems are added and the 
problems are arranged in order of difficulty Price: $2.00 per 
package of 25. Published by The Psychological Corporation 

Peters Biblical Knowledge Test, 1948, by Frank C Peters. Two tests 
of 150 objective items each for the Old and for the New Testa- 
ment. Working time for each test: 60 minutes. Range: high 
school, college, adult. Published by Bureau of Educational 
Measurements. 

S.R.A. Mechanical Aptitudes , by the staff of Richardson, Bellows, 
Henry and Company, Inc. Three types of problems are in- 
cluded: tool usage, space visualization, and shop arithmetic. 
Range: high school to adult. Working time: 35 minutes. Price: 
Reusable test booklets with answer pad, each 48 answer pads, 
package of 25, $1.75. Profile sheets, package of 25, tojf. Pub- 
lished by Science Research Associates. 

S.R.A. Primary Mental Abilities {Primary), by L. L. Thurstone and 
Thelma Gwinn Thurstone. Scores are obtained in the following 
areas: verbal-meaning, quantitative, space, perceptual-speed, 
motor. Range: kindergarten and first grade. Working time: 
One hour. Price: Test booklets, package of 25, $2.65. Pub- 
lished by Science Research Associates. 

S.R.A. Primary Mental Abilities ( Elementary ), by L. L. Thurstone 
and Thelma Gwinn Thurstone. Scores are obtained for five 
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primary mental abilities: verbal-meaning, space, reasoning, per- 
ception, and number, Range: Ages 7 to ir. Working time: 
One hour. Price: reusable test booklets with, answer pad, each 
48^; answer pads, package of 25, $1.7 profile sheets, package of 
25, 50fi. Published by Science Research Associates. 


Thomdike-Lorge Reading Test ( Forms A id B Revised ), by E. L. 
Thorndike and Irving Lorge, This is a general test planned to 
include all the important factors in silent reading and to give 
reasonable weight to each of them, Range: Grade 7 to 9. 
Working time: 40 minutes. Published by Bureau of Publica- 
tions, Teachers College, Columbia Univ. 


Thurstone Test of Mental Alertness, by L. L. Thurstone and Thelma 
Gwinn Thurstone. This test is a short form adaptation of The 
American Council on Education Psychological Examination for 
high-school students. Four types of problems are included: 
same-opposites, definitions, number series, and arithmetic reason- 
ing. Range: high school and adult. Working time: ao minutes. 
Price: Form API, handscored: test booklets, package of 2.J, $1.85; 
scoring folders, set 6ojf. Form AM, machine-scored: Test book- 
lets, package of 25, $3.00; scoring keys, set $1.00. Published by 
Science Research Associates. 


fpechsler Memory Scale Form 11 , 1948, by Calvin P. Stone and David 
Wechsler. A six-part test devised as an alternate form to the 
older JVechsler Memory Scale. Price: 50 record forms with set 
of test cards, $1.75. Published by The Psychological Corpora- 
tion. 


Your Activities and Attitudes , by Ernest W. Burgess, Ruth S, Cavan, 
and Robert J. Havighurst. This questionnaire is designed for 
the study of the personal adjustment of older adults. ‘Two in- 
ventories are included, The Adult Attitude Inventory measures 
the extent to which the older person finds personal satisfaction 
through his social contacts. The Adult Activities Inventory 
measures the degree to which he is able to participate in the ac- 
tivities typical of older adults.” Range: adults in later ma- 
turity. No time limit. Price: test booklets, package of 25, 
$2.75. Published by Science Research Associates. 
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TOWARD MORE ADEQUATE CRITERIA OF 
COUNSELING EFFECTIVENESS 1 

CLIFFORD P FROEHLICH 
Office of Education, Federal Security Agency 

When is counseling successful? Some enthusiastic writers 
have credited primitive man with the origin of the counseling 
process. Yet in this long history we have not developed ade- 
quate criteria of counseling effectiveness. Numerous investi- 
gators have dealt with evaluation of counseling, but no one 
has indicated complete satisfaction with the criteria employed. 
Typically, their reports have ended with a suggestion for 
further research, especially with an investigation to improve 
the criteria. Many guidance workers have carefully analyzed 
the problem, Examples of this thoughtful approach are found 
in a symposium published in Occupations in 1936. Stott 2 
in this symposium is dissatisfied with the criteria used in pre- 
vious evaluation studies. These criteria were: (a) the number 
of positions held, (b) the length of tenure of positions, (c) the 
reasons why positions have been left, (d) reports from employers 
on the efficiency of work, and (e) reports from workers as to the 
satisfaction with work. Although she finds fault with the use 
of these measures, she concludes that some combination of 
them might be desirable. She suggests that a judgment crite- 
rion based on success and happiness on the job be employed. 
The judgment would be arrived at by taking personal satisfac- 
tion with one’s work and modifying it by certain estimates, by 
examination results, or by obvious signs of lack of success. 
She favors only three criterion categories: successful, doubtful, 
and unsatisfactory. Viteles 3 in the same symposium stresses 

1 The data upon which this report is based were obtained in an evaluative study 
of the State Consultation Service, Richmond, Virginia. The General Education 
Board, the State Board of Education of Virginia, and the Offiice of Education, Fed- 
eral Security Agency, each made a substantial grant to finance the study. 

2 Mary B Stott, "Criterion Used in England,” Occupations , XIV(l9;;6), 953-957. 

8 Morris S. Viteles, "A Dynamic Criterion,” Occupations, XIV(i936), 962-967. 

2-55 



256 EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT 


the complexity of the problem involved in the definition of 
success or failure in setting up criteria for the evaluation of 
counseling. He suggests that we change our orientation and 
elaborate our methods in the experimental studies of vocational 
success so that they permit a study of the dynamic inter- 
relationships among the very many diverse factors making for 
success or failure in work. The concern of both Stott and 
Viteles with the lack of an adequate criterion is typical of many 
guidance workers. The study reported here took its cue from 
this concern. This investigation was designed to provide some 
comparative data on criteria which have been used or proposed 
for evaluating counseling, 

The study is based on a population of 740 persons who had 
availed themselves of the counseling services offered by the 
State Consultation Service at Richmond, Virginia. This 
sample included only former counselees whose cases were 
considered inactive or completed on January 1, 1947. All 
cases had registered with the Service for counseling during the 
years 1939 through 1946. 

The State Consultation Service is a state-supported, free 
counseling agency. Its present professional stall' is composed 
of a directing counselor, 4 counselors, 1 psychologist, and 1 
research worker and editor. In addition to counseling with 
individuals, the Consultation Service provides a test-scoring 
service, publishes a monthly journal entitled Work and drain- 
ing, and conducts an in-service training program for school 
guidance workers. The Service is well known and respected 
by guidance leaders throughout the East. 

Typically, the counseling process for each individual at the 
Consultation Service follows a similar pattern. The counselee 
comes for service and is interviewed by the directing counselor. 
If the client's problem appears to be one within the scope of 
services rendered, he is assigned to a counselor. After com- 
pleting several registration forms, the client is interviewed by 
the counselor to obtain a complete case history. If at the end 
of the interview, the counselor feels that test data are needed, 
an appointment with the psychometrist is made. After testing 
is complete, the counselor presents all data at hand to a staff 
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conference. Here an effort is made to arrive at a diagnosis of 
the client’s problem and to plan the counselor’s role in its 
solution. The counselor then begins the series of counseling 
interviews, which he continues until the case is closed. Before 
a case is closed, the directing counselor reviews the record to 
assure himself that all possible assistance has been given. 

Efforts to contact the 740 persons included in the study 
resulted in 279 follow-up interviews. In other words, 37.7 per 
cent of the former counselees furnished data upon which this 
study is based. There is evidence that the persons interviewed 
are reasonably representative of the original population. 
When the two groups were compared in respect to age and sex, 
no significant differences between the groups were found. For 
all practical purposes, the interviewed sample may be con- 
sidered representative of former clients selected for study. 

Interviews 

It was recognized at the outset that the reliability of the 
information obtained would depend upon the quality of the 
interviewers. Consequently, three minimum qualifications 
for interviewers were formulated. The first was a thorough 
training in personnel psychology. The second requirement 
was that the interviewers have satisfactory personal qualities 
The third, which is somewhat unusual, was that they be reared 
in the South. This final qualification was established to make 
it easier for the interviewer to gain the confidence of the 
counselees, who were themselves Southerners. These stand- 
ards were met by the two interviewers employed. Both, when 
first contacted, were completing their Master's degrees ; one in 
clinical psychology and one in guidance work. Although they 
attended different universities, both had supervised clinical 
practice. 

During the interview with clients, the interviewers were 
required to ask certain specific questions. The items of in- 
formation sought are listed in the schedule shown in Figure I. 
The items included in the follow-up interview schedule (Figure 
I) were formulated after reviewing the literature. An attempt 
was made to include a variety of items. Although some of the 
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ADDRESS PHONE . 

1. Case number, 

4. Marital status! 1— Single 2— Married 3 — Divorced 4— Widowed 5— Separated 


pradca 2— -5 Lo 7 grade* 3~com pic ted elementary 
^ome College 7— College graduate 8— Graduate work 


^ ployed on part-time jpb^ 


Kckini, work 2-Unomploycd, not scetine work 
. ■ l non-relief job 5 — Employed on relic! job 6 — Em- 

" tc 999 for "attending school full time.” 

. items 10 k UJ2 % U, and H. 

■10. ■■ . Wor the type of work'you are doing now? 1— Great deal 

^ itulIC 

*11. Did SCS influence your decision to Uke present work in ways other than PLANNING? 

1— Yea 2— No 

-12, If you did not follow plan, why didn’t you? 

1— No plan suggested 2—Dfdn't like plan 3— Health 4— Finances 5— Family influence 

Armcdi forces 7— Tried and failed 8— -Other (Specify) 

9 — Followed plan 

-13. Arc you satisfied with work, prospects, and pay of your present position? 

1— Work, prospects, pay 2— Work, prospects 3— Work, pay 4— Prospects, pay S— Work 
6— Prospects 7— -Pay 8— None 9— Unemployed 
-14 If you want to change work, why do you want to? 

1— Like other work better 2— More money 3— More opportunity 4 — Not getting nlong in 
present job 5— Family or friends want me to 6— -Forced to change 7—More ability in 
other line of work 8— Other reason No change desired 

flOTE’ If (juu fiat tonal questions JO to II are used, Put was in items IS, 16, 17, IS, and IP, 
EDUCATIONAL ADJUSTMENT 

-15 How much did SCS help you PLAN for the type of training you are taking? 1— Great deal 

2 — Some 3— None 

-16. Did SCS InQuencc your decision to take training In other waya than PLANNING? 1— Yes 
2 — No 

-17, * r l ' by not? 

■ ^ r* Didn't like plan 3— Health 4-*Finance 5— Family influence 

‘ .i . ■ and failed fi— Other (Specify),, ...... 


-18. 

-19 


-20. On a scale c 


training? 1— Very well 2— Fairly well 3— No 
training, wlint do you plan to do? 

ype 2— Different type of training 3— Keep on anyway 4— Get 


ale of 100, considering a slate of average adjustment aa 50, indicate your estimate of 
* ' '■ ^ " 1 ‘ t the time of interviewing this interviewee. 

-22. * ' \ - . . - by SCS helpful? 1— Yea 2~No 3-None 

suggested 

-23, Did the SCS help with any personal problems other than vocational? 1 — Yea 2— No 3— No 
other problems 

-24. At the time of counseling, did you have problems which the SCS did not discuss with you? 


1— Yes 2— No If yes, what kind of problems? 

' pfexi — u - 


2— Few 3— None 
’Hies? 

‘bool frlenda 4— Old friends 


you take part? 

/e too many 

50, indicate your estimate of 


—25, Do you have perplexi- 
-26 With whom do you for 
1— Business associates . 

In community 5— No 
-27. How do you fcol about 
1 — Have just about rig 
-28. On a scale of 100, const 
the personal ad justmen ■ 

GENERAL ITEMS 

-30 How well do you remember the SCS? 1— Quite well 2— Fairly well 3— Hardly at all 
-31. Do you feel that your counselor was helpful? 1 — Very much 2— Some 3— Not at all 
—32. Which of the following was most helpful? 

1 — Tests 2— Counselor’s suggestions 3 — Just talking it over 4 — Vocational information 
from library 5 — Some one the counselor suggested you contact 6— All generally helpful 
—33. Which of the following was least helpful? 

1 — Tests 2— Counselor’s suggestions 3 — Just talking It over 4 — Vocational information 
from library 5— Some one the counselor suggested you contact 6 — All of little help 
—34. Have you recommended the SCS to anyone? i— 3 or more persons 2 — 1 or 2 persons 

3 — No one 

—35, Comparing counseling services with other kinds ot professional services which have been 
rendered you, wbat do you think would have been a fair price to have paid for counseling? 
If Over 3999, record hero 

—38. Do^ou think that the StateDepartmcntofEducotion should provides Consultation Service? 
—39. Interviewer; 1— Spivey 2— Snell 3— Frocblfch 

—40, Do you have any suggestions for Improving the Consultation Service? 1 — Ycb 2— No 
W hat are they? , , . 


Figure I— Schedule roa Recording Follow-Up Data 
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items were modified, the basic element of each had been pre- 
viously used or proposed by guidance workers as a suitable 
criterion for the evaluation of counseling. 

It was left to the interviewer to decide the order in which 
questions were asked. No restrictions were placed on the use 
of additional questions or the length of the interview At the 
conclusion of the interview, the interviewers rated the occupa- 
tional (or educational, if attending school full time), and per- 
sonal adjustments of the client. They were given the following 
written instructions regarding ratings: 

On a scale of ioo, considering a state of average adjustment 
as 50, indicate your estimate of the personal adjustment of this 
person at the time of interviewing. 

The same instructions for the other ratings were used by 
substituting “occupational” or “educational” for “personal.” 
The ratings were recorded in numerical form on the follow-up 
schedule shown in Figure I. 

This procedure of having interviewers rate former counselees 
on their vocational and personal adjustment is fraught with 
danger. Ratings were used in this investigation for two 
purposes: (1) to give the interviewer a convenient means of 
expressing his general opinion of the client’s adjustment; and 
(2) to provide a means of comparing this interviewer-judgment 
criterion with other criteria. 

Before the interviewing of former counselees was begun, two 
steps were taken to increase the reliability and validity of this 
process. First, one of the interviewers and the writer inter- 
viewed each of the counselors on the staff jointly. Role- 
playing techniques were used, with the counselors taking the 
role of former counselees. This gave an opportunity to test the 
wording of the questions and to get the feel of the interview. 
Ratings assigned independently by the interviewer, counselor, 
and the writer were compared informally. The reasons for 
discrepancies were discussed, where questions had been mis- 
leading, they were re-phrased. 

One counselor then selected 5 and another selected 6 former 
counselees about whom they had extensive information regard- 
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ing occupational and personal adjustment. They were in- 
structed to select only those counselees for whom they felt they 
could make valid adjustment ratings. One interviewer then 
interviewed these 1 1 counselees and rated their adjustment. 
The rank difference correlation between interviewer’s and 
counselors’ ratings for occupational adjustment was found to 
be 737. For personal adjustment it was +.794. Although 
these coefficients are not as high as desired, they do indicate 
substantial agreement between counselors and this interviewer. 
Upon the basis of this evidence, the rating procedure was con- 
sidered worthy of further trial. 

Each of the interviewers interviewed 25 former counselees. 
At intervals they sat down together and rated each other’s 
interviewees in the following manner. The person who had 
interviewed the client would reproduce the interview as ac- 
curately as she could. The other interviewer would continue 
to ask questions until she was ready to make a rating. In 
cases where these questions had not been asked of the client, 
no response was given. The role-playing interviewer’s attempt 
was to report facts obtained, but not impressions, The 
original ratings which had been made were not revealed to the 
interviewers until after re-ratings were completed. Rank- 
difference correlation coefficients were then computed. When 
ratings made by the real interviewer were compared with re- 
ratings by the second interviewer, the rank-difference correla- 
tion coefficient for personal adjustment was found to be +.811, 
and for occupational adjustment, +.776. When the roles 
of these two interviewers were reversed, the coefficients were 
+ .902 and +,900, respectively. The data on the com- 
parability of ratings are not presented as conclusive evidence 
They represent, rather, the results of a preliminary skirmish 
with a very difficult research problem. 

At the conclusion of the follow-up interview, the personal 
adjustment of all clients was rated. The distribution of each 
interviewer’s ratings of personal adjustment is shown in Table 1 . 

Table 2 presents the distribution of occupational adjustment 
ratings. Only employed clients were rated. The total em- 
ployed sample is composed of 206 persons. Clients attending 
school full time were rated on their educational adjustment. 
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Since they numbered only 26, they are excluded from the study. 
The personal adjustment ratings of these clients are, however, 
included. 

The data presented in Tables i and a indicated the prob- 
ability of interviewer differences. Therefore, the significance 
of the difference between mean ratings was ascertained. It 

TABLE i 


Distribution of Personal Adjustment Rating for Each Intervtcwer 


Rating 

Interviewer 1 



Interviewer 1 

Number 

Cumu- 
lated % 

Number 

Cumu- 
lated % 

o~io 

3 

2 2 

I 

• 7 

11-20 

I 

a. 9 

2 

2. I 

2I-30 

3 

S 1 

II 

9.8 

31-40 

8 

II. O 

8 

15 4 

4 i ~5° 

IS 

22. I 

24 

32 2 

SI-60 

4 

2S .O 

1 

32-9 

61-70 

II 

33 1 

20 

46 9 

71-80 

31 

ss 9 

36 

72 O 

81-90 

49 

91.9 

31 

93 7 

91-100 

II 

100.0 

9 

IOO O 

Total 

136 


143 



TABLE 2 

Distribution of Ratings of Occupational Adjustment of Employed Persons 


Rating 

Interviewer 1 

Interviewer 2 

Number 

Cumu- 
lated % 

Number 

Cumu- 
lated % 

0-10 

2 

1 9 

5 

4 9 

11-20 

2 

3.9 

2 

6 9 

21-30 

9 

12 6 

IO 

16 7 

31-4° 

6 

18 4 

IO 

26.4 

41-so 

7 

25,2 

8 

34-3 

51-60 

1 

26 2 

0 

34-3 

61-70 

5 

31.1 

12 

46. 1 

71-80 

24 

54 4 

21 

66 7 

81-90 

32 

85.4 

1 6 

82.4 

QI-IOO 

IS 

IOO 0 

18 

100 0 

No rating’" 

I 


0 


Total 

104 


102 



* Excluded from computation of cumulated percentages 


can be seen from Table 3 that the difference between inter- 
viewers’ ratings of personal adjustment is highly significant. 
Since it was desirable to have as large a number of cases as 
possible for the analysis, the raw ratings of both interviewers 
were converted to a five-point scaled rating. This was ac- 
complished by assigning that per cent of the cases to each 
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scaled rating that would have been obtained in a normal 
distribution. Scaled ratings were set at intervals of one 
standard deviation, the middle interval extending one-half 
standard deviation in each direction from the mean of a normal 
distribution. Thus, the theoretically scaled rating 5 was 
assigned to the highest 7 per cent of each interviewer’s ratings. 
The next 24 per cent of the ratings were assigned a scaled 
rating of 4. The scaled ratings 3, 2 and 1 were each assigned 
to 38, 24 and 7 per cent of ratings, respectively. Only minor 
deviations from theoretical percentages occurred in the distribu- 
tion of scaled ratings actually obtained. In the analysis of the 
data in this investigation, these scaled ratings were used in 
preference to raw ratings. 


TABLE 3 

The Mean, Standard Deviation, Difference Between Means, Standard Error of Mean, 
and Critical Ratio for Interviewers' Ratings rtf Clients' Adjustment 





Interviewer 


Difference 

between 

Means 

Standard 
Error of 
Difference 


Tyrw of Adjustment 

Mean 

One 

— std: 

Two 

Moan 

s.d: 

Critical 

Ratio 

Occupational .... 

iHTfM 

»S-« 

86.9 

26.8 

4-7 

3.5 

1.3 

Personal, 

yHsi 

21.6 

66.1 

21.6 

14-3 

2.6 

5.6 


y reatment of the Data 

The data were transcribed to punch cards from the interview 
schedule according to the code shown in Figure I. Tabulations 
were completed by machine. 

The interview follow-up data were first analyzed for rela- 
tionships among the various items. The purpose of this 
analysis was to find those variables which appeared to be 
satisfactory criteria of counseling effectiveness. The computa- 
tion involved only routine statistical procedure. As a measure 
of the independence of the variables, chi square was computed. 
P-coefficients were then obtained from Pearson’s tables 4 to 
indicate the chance probability of obtaining a chi square of 

4 Karl Pearson, Tables for Statisticians and BtometrJc/ans, Part I, Second Edition, 
pp. xxi-xxxiii, 26-28. London: University College, Biometric Laboratory. 1924. 
(In cases where the degr ees o f fr eedom exceeded 29, the P-coefficienc was obtained 
by using the expression \AX a v^an — 1 as a normal deviate with unit standard error. 
The error in degrees of freedom in Pearson's table was corrected according to the 
method proposed by G. Udney Yule and M. G Kendall, An Introduction to the Theory 
of Statistics t p. 389. London: Charles Griffin and Company, 1937*) 
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that magnitude with the given number degree of freedom by- 
chance. The coefficient of contingency was used to indicate 
the degree of relationship between variables. Thus probability 
of a true relationship and an indication of its intensity were 
obtained. 


Findings 

The data dealing with educational adjustment were elimi- 
nated because only 16 cases were obtained in these categories. 
Intercorrelations among the remaining follow-up items were 
obtained. This table of intercorrelations was then inspected 
as a basis for selecting criterion items Three standards guided 
the selection of items First, the items should be relatively 
independent of other criteria used in this investigation. Second, 
the items should not be greatly influenced by the bias of the 
follow-up interviewer. The third standard was that the items 
should hold promise of being rather stable. The mechanical 
application of these standards for the selection of criteria was 
not possible. In their application it was necessary to take into 
consideration the nature of the basic data. For example, the 
changes in clients’ marital status was rejected as a possible 
criterion because it was so closely associated with the amount 
of time elapsed since counseling. The kind of associates was 
not used because the distribution of responses precluded the 
development of meaningful categories, containing sufficient 
numbers 

Data relative to the relationships among the items selected 
are presented in Table 4. When a P-coefficient of .05 or less 
was obtained for the relationship, an asterisk appears with the 
contingency coefficient shown in Table 4 Therefore, the 
relationships which are significant at the 5 per cent level can be 
identified readily. 

Occupational Adjustment Criterion 

The occupational adjustment criterion items are the first 
three shown in Table 4. It can be seen that they correlate 
significantly among themselves. Thus, they meet one of the 
standards, because such intercorrelation can be expected to 
contribute to their stability as an occupational adjustment 



264 educational and PSYCHOLOGICAL measurement 



* A P-coefficient of .05 or less was obtained for this relationship. 

t A complete statment of the items in this Table may be found by reference to schedules shown in Figures I and 2. The first number in the 
■entheses after each item refers to the Figure and the second to the item within the Figure. 
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criterion. They are not as independent of the personal 
adjustment criterion as desirable for unique criteria. From a 
statistician’s point of view, no association between personal 
and occupational items would be desirable. But from the 
guidance worker’s angle, the demonstrated relationship be- 
tween the two might be taken as evidence of validity. Few 
guidance workers would believe that personal and occupational 
adjustment are not inextricably entwined. The occupational 
adjustment criterion items, however, do appear to be inde- 
pendent of the client’s attitude and changed-status criteria. 
The job-satisfaction item used three categories, those who were 
satisfied with work, prospects, and pay; those satisfied with 
any two of these; and those satisfied with only one, or none. 
The responses to the question “If you want to change work, 
why do you want to?” were categorized into those who desired 
a change and those who did not. The five-fold categories on 
adjustment rating have been described previously. 

Personal Adjustment Criterion 

The personal adjustment criterion items are numbered 4, 5 
and 6 in Table 4 Although they do not correlate as highly 
among themselves as the occupational adjustment items, a 
cluster of significant correlations is evident. In the application 
of these criterion items, greater variability may be expected 
than in the occupational adjustment items. The items appear 
to be relatively independent of the other criteria with the 
exception of occupational adjustment rating. This dependence 
was discussed in the preceding paragraph. Responses to the 
follow-up question, “Do you have perplexing personal problems 
now?” were divided into those who had problems and those 
who did not. The three categories of responses on the inter- 
view schedule (Figure I) were used for the question, “How 
do you feel about the number of social activities in which you 
take part?” The five-fold scaled personal adjustment rating 
previously described was used. 

Client Attitude Criterion 

The third criterion division contains items which appear to 
reflect the client’s attitude toward counseling. They are 
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numbered 7, 8 and 9 in Table 4. Clearly these items tap an 
area not covered by the other criteria. When the three were 
compared with other criteria, all P-coefficients were greater 
than .05, When the three are compared among themselves, 
all P-coefficients were less than .05. In addition to this 
statistical justification of their use as a third criterion cluster, 
another factor entered into the decision to include them in the 
criteria. Although they do not reflect outcomes which can 
be considered to affect directly the status of the counselee, it 
was felt that their use might reveal factors which influence the 
counselee's attitude toward counseling. It is believed that the 
effectiveness of counseling depends, in a large measure, upon 
counselee attitude. The three categories of respones for each 
of the questions which are shown in Figure I were used in 
treating the data. The three questions in this group were: 
“How well do you remember the State Consultation Service?”, 
“Do you feel that your counselor was helpful?” and “Have 
you recommended the State Consultation Service to anyone?”. 

Change of Status Criteria 

The criteria which have been discussed are essentially cross- 
sectional items. They are designed to reveal the status, 
activities, or beliefs of the counselee at the time of counseling 
without reference to conditions prior to counseling. A longi- 
tudinal study of individuals before and after counseling repre- 
sents a different approach to the problem of evaluation. Two 
such criteria are included in this investigation. They are 
shown in items 10 and 11 in Table 4. It was not within the 
resources available to include a great variety of items which 
would reflect change in status. In addition to the two items 
selected as criteria, marital status and employment status were 
included in the follow-up schedule. The distribution of re- 
sponse and the pronounced influence of non-counseling factors 
led to the decision to discard them as criteria in this investiga- 
tion. Both of the change-in-status criteria appear to be inde- 
pendent of the other criteria. 

The occupational-change criterion reflects major changes in 
occupation, The Dictionary of Occupational ‘Titles’ code for 
client's occupation at time of counseling was compared with the 
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code for his occupation at time of follow-up. For purposes of 
this investigation, only the changes in the first digit of the code 
were considered as changes. Essentially this procedure identi- 
fied these persons who have moved up or down the occupa- 
tional hierarchy. For example, changes from unskilled to 
skilled occupations were identified. But changes from ma- 
chinist to carpenter would not be included. Of the 196 clients 
who had an occupation at time of counseling, and at follow- 
up, 69 had made a change. 

Similarly, changes in the amount of schooling from the time 
of counseling to the time of follow-up were identified. Only 
changes from one to another of the 9 categories shown in item 
J of Figure I were considered. Of the 266 whose educational 
level was known at both times, 121 changed. There were only 
13 of the 266 who were attending school full time at the time of 
counseling. 

It would have been possible to identify changes which were 
not as gross as those selected for criteria. The gross changes 
appeared to be more desirable because they tend to identify the 
extreme cases. The writer believes that if significant relation- 
ships could not be found with these gross criteria, there is little 
likelihood that finer discrimination in changes would reveal 
significant relationships. 

Summary 

It is recognized that the criteria selected are not all inclusive 
or mutually exclusive. It appears, however, that they can be 
thought of as criteria which may be useful for the evaluation of 
four aspects considered indicative of the effectiveness of counsel- 
ing. The aspects are: the counselee’s occupational adjustment, 
his personal adjustment, his attitude toward counseling; and 
changes in his occupational or educational status. Another 
study to be reported will discuss the application of these 
criteria. 




TEST CALIBRATION FOR CATEGORICAL 
CLASSIFICATION 1 

GILBERT L. BETTS 

Editor, Educational Test Bureau, Minneapolis, Minn. 

In business and industry, as in the Armed Forces, psycholog- 
ical testing is usually done to facilitate the classification of 
personnel into predetermined categories. Common examples 
of such categories are acceptable or non-acceptable, satisfactory 
or unsatisfactory, and successful or unsuccessful. Although in 
reality such categories are not discrete, they must be so con- 
sidered for administrative action. 

For this reason a psychologist is often called upon not only 
to measure but to classify. When measurements are taken 
along a continuum similar to an ability scale, the classification 
of a borderline case is difficult to accomplish and the accom- 
plishment is difficult to defend Much of the difficulty might 
be avoided, however, if tests used for categorical classification 
were calibrated from a different point of view. The present 
study explores this possibility 

The Proposed Scale 

It is proposed to substitute a quality scale for the conven- 
tional difficulty scale. Conventional scale values are functions 
of a unit-normal distribution the parameters of which are de- 
rived from one population sample. This sample is assumed 
to be representative of the universe from which it is drawn. 
Scale values in the proposed quality scale are functions of two 
unit-normal distributions. The parameters of one of these are 
derived from a population sample possessing the desired quality 
or qualities; the parameters of the other are derived from a 
population sample possessing the contrasting and undersirable 
quality or qualities. For scale-making purposes the quality 
of the first sample is judged to be higher than that of the second. 

1 Based on a paper read at the annual meeting of the American Psychological 
Association, Detroit, September io, 1947 

269 
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The proposed scale values are a function of the two over- 
lapping tails, For a given score a certain theoretical proportion 
of cases under the upper curve will fall in the tail below this 
point and a certain proportion under the lower curve will fall 
in the tail above this point. Thus as the size of score increases, 
the proportion under the upper curve increases and the pro- 



Fiqurb I The Relative Likelihood of a Given Score X Falling in the Tails of 
Two Distributions When the Overlapping is as Shown 



Figure II The Relative Likelihood of a Given Score Y Falling in the Tails of Two 
Distributions When the Overlapping is as Shown 


portion under the lower curve decreases. Figures I and II il- 
lustrate what is meant. The score of X in Figure I is Jo- below 
the mean of the upper group, to the right. Normally about 31 
per cent of the cases fall in the tail of the distribution below 
this point, But in the lower group the score of X falls 1 Jo- 
above the mean. Consequently about 7 per cent of the cases in 
this distribution fall In the tail above it, The two proportions 
to be used are therefore .31 and ,07, In Figure II the situation 


TESTING FOR CATEGORICAL CLASSIFICATION 


27I 


is reversed, and the two proportions are .07 and .31. A point 
(P) on the proposed quality scale is obtained by the formula 

p = 100 <2u 
q\L + qi 

where 7 is the proportion of cases in the tail of the distribution, 
upper or lower as the case may be, obtained from a normal 
probability integral table. It should be remembered, however, 
that in the portion of the quality scale extending beyond the 
mean of a distribution, these 7-values usually are tabled under 
p instead of q. 

Calculation of the complete series of points on the proposed 
quality scale may be illustrated by reference to Figures I and 
II. In Figure I, score X is — \a u and + ifcr;. The corresponding 
7-values are, q u — .31 and q ; = .07. Substituting these values in 
the above formula gives 


P 82 


.31 + -07 


= 82. 


In Figure II, score T is — i|<r„ and +501 and has 7-values of 
7„ = .07 and qi = .31. Substitution gives 


Pi 8 = 


7 - 

.07 + .31 


18. 


A test may thus be calibrated by substituting the two 7-values 
of each raw score in the above formula. This gives a theoretical 
scale beginning with zero and ending with 100, both values 
being mathematical certainties pertaining to the correct classi- 
fication of a person in the upper one of two categories. 

The 50-50 cutting point (P50) is given by the following 
formula : 


= 


(TlMy -f- CyMj 

Cl + C u 


where subscript l refers to the lower category and u to the 
upper. 2 This point (P 5 0) is such that the proportion of lower 

2 1 am indebted to Dr. Truman L, Kelley for suggesting this formula to replace the 
following 


PfiO 


*y 


X + y 

where x is the number of upper category sigmas between the two means and y is the 
number of lower category sigmas between the same two points The two formulas yield 
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category cases falling in the tail above it equals the proportion 
of upper category cases falling in the tail below it. In the lan- 
guage of the layman, because the chances are equal, this con- 
stitutes a 50-50 chance that a person making such a score could 
be correctly classified in either category. 

Layman are warned, however, that this procedure differs in 
no way from all other test calibration procedures based on func- 
tions of the normal frequency curve; all such procedures assume 
that the means and standard deviations used in the formula 
are obtained from normal distributions. In case the two dis- 
tributions to be differentiated are not normal, the calibration 
is in error, and the greater the departure from normality the 
greater the error. One should also remember that the standard 
error of each element in the formula is partly a function of the 
number of cases in the distribution from which it is obtained. 
Therefore, if the number of cases in one distribution is smaller 
than the number of cases in the other, the standard error of 
a calibration point is thereby increased. Both distributions 
should be equally large, but not equally small. This is ap- 
parent from the following formula for the variance error of 
the jP (0 calibration point. 3 

2 __ ( 1 1 1 \ /afvi + v u ) a + {Mi + Ml) 2, 

“ \N, + Nj (crT+TT \ a 

Empirical 'Fry-out 

To determine the functional aspects of such a scale when 
applied to differently spaced criterion groups, scales are here 
derived from successive pairs of distributions with less and 
less overlapping. Mental age distribution, obtained by using 
the Kuhlmann-Anderson Intelligence Fest in Grades from I 
through VIII, were used. The number of cases in each grade 
varied from 1,458 in Grade I to 4,700 in Grade VIII, with a 
total of 24,622 cases. 

Four pairings were made: Grades V and VI, IV and VI, III 

identical results when the original Pis is converted to raw score (X or Y) by either 0/ 
the following formulas: 

X * — ouPm and Y =» M| -j- viPm 

* An unpublished formula derived by Dr. Truman L. Kelley 
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Figure III Mental Age Distributions in Grades V and VI, with Grade Means 
(Kuhlman-Anderson Intelligence Test) 


FREQUENCY 



GRACE II III IV V VI VII VIII 

Figure IV Mental Age Distributions in Grades IV and VI, with Grade Means 
(Kuhlman-Anderson Intelligence Test) 


FftEQUE KICV 



GRADE IT ITT IV V VI VII VIH 

Figure V Mental Age Distributions in Grades III and VI with Grade Means 
(Kuhlman-Anderson Test) 
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and VI, and II and VI. These distributions are shown in Figures 
III to VI inclusive, The mean mental age of each grade level is 
also shown. The basic mental age statistics are given by grade 
in Table r. The method of calculation is illustrated in Table 2. 

rnta.uiHCY 



Fiourb VI Mental Age Distributions in Grades II and VI, with Grade Means 
(Kulilmann-Anderson Test) 

TABLE 1 


Menial Age Statistics in Months, by Grade, Using the Kuhbnann-Andcrson Intelligence 
Test. From Frequency Distribution in Bulletin No. 42 (.1945), Educational 
Records Bureau, New York 



Grade 

Castes 

Mean 

Std Dev. 


I 

H 5 8 

85. B 

*6.7 


2 

1680 

101,4 

8 .IJ 


3 

aoog 

nj .8 

10. 8 


4 

2886 

I 3 1 ' 0 

ir .8 


s 

333 * 

1 JO . 9 

12. 8 


6 

41 53 

161,8 

1J.3 


7 

4*04 

178.1 

*17 0 


8 

4700 

192.6 

*23.7 

Total., .. 


... , 34,622 

_ 

— 


* Unused, Estimated from the semi-interqunrtile range. 


The four scales are presented in tabular form in Table 3 and in 
graphic form in Figure VII. 

The ioo-point scale applied to mental ages takes the form 
of an ogive curve. It applies automatically to the doubtful 
range only. Beyond this area correct classification becomes 
practical certainty. The interval between scale units is greatest 
in the central area of greatest doubt and least in the extreme 
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TABLE i 

JVork Sheet for Deriving the Scale Values of Mental Age from Two Overlapping Groups , 
Fifth and Sixth Grade Pupils Derived from data in Table i 


Upper group 


Probability* 


Lower group 
X - M 


3 08 

.001 

—2.80 

997 

0. 1 

a.75 

.003 

-a. 4 i 

992 

0 3 

1 42 

.008 

— a 02 

978 

0 8 

2.0 9 

018 

— 1.63 

.948 

1 9 

1.83 

• 034 

-1.24 

893 

3.7 

I 43 

.071 

- -85 

. 802 

8 I 

1. 10 

.136 

— 46 

.677 

16 7 

• 7 8 

.218 

- .07 

528 

29. 2 

•447 

326 

■32 

374 

46 6 

.117 

• 453 

•7i 

•239 

65 4 

.210 

• S83 

1. 10 

• 135 

8l.2 

•539 

.705 

1.49 

.068 

91.2 

. 869 

.808 

1.88 

030 

9b 3 

1 20 

885 

2. 27 

.012 

98.6 

i-53 

■937 

2 66 

.004 

99 7 

1.85 

968 

3-°5 

001 

99 9 


* Proportion of cases in the tail of the distribution beyond X, from a normal prob- 
ability integral table. , , , , , „ loo q„ 

■V Obtained from q-values in columns 3 and 5 by the Formula r = — 

Qu "r qi 

TABLE 3 

Scale Values for Mental Age, Determined from Variously Spaced Paris of Overlapping 

Groups 


Scale Values 


Mental 

age 

(months) 


Graces 

V & VI 

Grades 

IV & VI 

JC) 

Grades 

III & VI 

MA 

(months) 

Grades 
II & VI 

1 

. 1 

.2 

108 

. I 

• 3 

•4 

■ 9 

no 

1 

8 

1 . 1 

3-9 

112 

•5 

1-9 

3-3 

1 5-9 

II 4 

1 3 

3-7 

8.5 

47.2 

Il6 

2,6 

8 1 

24.1 

8?. 6 

Il8 

8 7 

16 7 

53 7 

97.8 

120 

20 7 

29 2 

80.2 

99-5 

122 

40.0 

4;. 6 

94.0 


124 

66.7 

65.4 

98.5 


126 

90,0 

81 . 2 

99.6 


128 

96 3 

91.2 

99-9 


130 

99.0 


180 

185 

I90 


132 

134 


99-5 

99-9 
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areas of greatest certainty. As overlapping decreases and ap- 
proaches zero the ^-curve tends to become a straight, perpen- 
dicular line passing through a point that separates the two 
groups with absolute certainty. 

Practi c ability 

These characteristics seem to make the proposed scale ad- 
mirably suited to tests used for classifying personnel into pre- 

SCALE 

VALUES 



MO IZO 130 (4-0 150 160 I VO I SO 190 

MENTAL AGE IN MONTH S (XUHLMAUN ANDERSON) 

Fiourb VII Quality Scales from Four Pairs of Criterion Groups with Different Amounts 

of Overlap 


determined categories. Its practicability was verified by con- 
structing a new test, calibrating it in this manner, and applying 
it to an adult population. This has been previously described. 1 

Briefly, the test was a Biographical Case History consisting 
of 67 multiple-response, single-choice items. The two criterion 
groups consisted of 1050 normal operative soldiers and 1177 
general army prisoners. The two overlapping frequency dis- 
tributions are shown in Figure VIII. The mean raw score for 
the normal group was 47.6, and for the imprisoned group, 30.2. 
The standard deviations were 6.8 and 9.3, respectively. From 

1 Betts, Gilbert L. "The Detection of Incipient Army Criminals.” Science, CVI 
(1947), 93-96. 
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these data and in the manner illustrated in Table 1 , the scale 
values shown graphically in Figure IX were derived. 


FREQUENCY 



Figure VIII Distribution of Raw Scores on a New Test in a Pair of Adult Criterion 

Groups 


SCALE 

VALUES 



Figure IX Quality Scale from a Pair of Adult Criterion Groups on a New 

Test 

During a subsequent 1 8-month period, The Biographical Case 
History was administered at the induction station level in the 
Seventh Service Command to about 4,634 selectees with crim- 
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inal records. The critical score varied from time to time and 
from station to station in accord with the amount of risk con- 
sidered advisable under current circumstances. In this very- 
practical situation the scale was found to be exceedingly use- 
ful Classification difficulties were less acute than those met 
through the use of mental ability scales calibrated in the con- 
ventional manner. Because transmuted scores were based on 
criterion differences, validity was always in the open and classi- 
fication could be defended easily. 

Other Possible Applications 

It seems highly probable that the same form of test calibra- 
tion will be equally useful in other situations. Suppose, for 
example, an employer desires to increase the number of em- 
ployees in a certain job or job family. His psychologist can 
follow a procedure somewhat as follows. First the employer 
would identify two criterion groups; for example, one satis- 
factory and the other not. Next, the psychologist would select 
a test that discriminates significantly between these two groups. 
Using the means and standard deviations from the two dis- 
tributions, he can easily calibrate the test in the manner here 
described. 

Having the test thus calibrated, he needs only one item of 
information from the employer: How far and in which direction 
from the 50-50 cutting point (P S(J ) does he wish to go? Knowing 
this, the psychologist can select personnel of a quality no less 
than the employer desires. In stringent times, when profits are 
low and personnel plentiful, the employer may desire to take 
practically no risk in the matter of personnel. At other times 
when manpower is scarce and profits high, more risk is war- 
ranted. 


Summary 

The need for having tests calibrated on a quality scale arises 
from difficulties encountered in the classification of borderline 
personnel into predetermined categories. The proposed scale 
was studied experimentally from a succession of differently 
spaced criterion groups. As thus studied, its characteristics in- 
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dicated that it was admirably suited for the purpose contem- 
plated. 

The practicability of the scale was verified through actual 
use. A new test, called the Biographical Case History, was con- 
structed, calibrated by reference to two contrasting criterion 
groups, and used successfully for measurement and classifica- 
tion purposes. The nature of further applications that may be 
made was illustrated. 




A GENERAL APTITUDE TEST BATTERY STUDY 
WITH HIGH-SCHOOL SENIORS 


STATE TESTING STAFF 
Ohio State Employment Service 

During the 1947-48 school year, the United States Employ- 
ment Service’s General Aptitude Test Battery (GATB) was ad- 
ministered to a group of 439 high-school seniors as part of an 
experimental cooperative program for counseling and testing 
high-school youth by the Ohio State Employment Service and 
the Ohio State Department of Education. 

The primary purpose of this study was to investigate the 
distributions of aptitudes and of occupational aptitude patterns 
in a high-school senior group. Such a study would give informa- 
tion regarding the use of the GATB with respect to its use in 
guidance and placement on the secondary-school level. 

Five northern Ohio schools participated in the program. Two 
of the schools were in semi-rural communities and three were in 
communities suburban to large industrial centers. School guid- 
ance personnel and employment service counselors were trained 
by the Ohio State Employment Service staff in the use and in- 
terpretation of the test battery. The test scores were used by 
school and employment service counselors to assist in individual 
counseling of members of the senior classes. 

Tests in the General Aptitude Test Battery 

The Battery consists of fifteen tests found by factor analysis 
to measure ten aptitudes which appear to contribute to occupa- 
tional success in many jobs (3). Eleven of the fifteen tests are 
paper-and-pencil, and four are apparatus tests. Each of the 
tests has been designated by a letter, as Part A, Part B, and so 
on, up to Part P. 

Aptitudes Measured 

These fifteen tests or parts are purported to measure ten apti- 
tudes, as follows; (The letter preceding each aptitude indicates 
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the letter used to identify the aptitude.) G — intelligence, V — 
verbal ability, N — numerical ability, S — spatial aptitude, P — 
form perception, Q — clerical perception, A — aiming or eye-hand 
coordination, T — motor speed, F — finger dexterity, and M — 
manual dexterity. 

Occupational Aptitude Patterns 

The term “Occupational Aptitude Pattern” refers to the 
combination or pattern of aptitudes that is required to perform 
satisfactorily the major tasks of a given occupation. To date, 
norms have been developed for twenty fields of work represent- 
ing approximately a,ooo occupations (i). The Occupational 
Aptitude Patterns have been related to the Part IV classifica- 
tion code structure of the Dictionary of Occupatiorial Pities. The 
patterns were established after job analyses and analyses of test 
scores of samples of successfully employed workers in each field 
showed that certain occupations seemed to require a similar 
minimum amount of the same combination of aptitudes. Each 
pattern consists of minimum scores for only the most significant 
aptitudes required for the group of occupations covered by the 
pattern. 

The minimum aptitude scores are expressed in terms of 
standard scores with loo as the general population average 
with a standard deviation of 2 o. 

The following are illustrations of typical Occupational Apti- 
tude Patterns. Pattern I is G V— -intelligence and verbal apti- 
tude; occupations requiring considerable degrees of these apti- 
tudes include creative writing, translating, copy writing and 
journalism. Pattern a is G N — intelligence and numerical apti- 
tude; occupations such as accountant, auditor, statistician, 
and assessor apparently call for more of these two aptitudes. 
Pattern 3 is G N S P — intelligence, numerical aptitude, spatial 
aptitude ancl form perception; this pattern covers jobs in the 
fields of structural, mechanical and electrical engineering, 

Five Occupational Aptitude Patterns are designed mainly 
around clerical occupations. They are: 

5, GNQ — Computing and General Recording Work 
8. VQTF — Typing, Stenographic Work, Typesetting and 
Hand Composing 
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11. NQ — Equipment and Material Checking and Routine 
Recording Work 

12. NQTF — Computing and General Recording Work 
19. QT — Classifying and Routine Clerical Work 

The eight patterns mentioned above are the only ones dis- 
cussed specifically in this study. 

Statistical Analysis' 

Tlie Test Record Card is a form containing the raw test 
scores, standard aptitude scores, and the Occupational Aptitude 


TABLE 1 
G Aptitude 



From Grouped 
Data 

Sheppard’s 

Correction 

Males, School i — N =17 

Females, School 1 — N — 15, 

Males, School 2 — N = 81 . . . , 

Females, School a — N —>96 

Males & Females, School 1 — N = 32. . . . 

SD = 14 

SD = 12 8 

SD = 16 4 

SD = 14 8 

SD = 14 4 



Patterns for which each senior qualifies. All cards of the 439 
seniors were numerically coded with the following items: indi- 
vidual identification, sex, school, high-school course, and age. 
This information, plus the individual’s ten standard aptitude 
scores and the Occupational Aptitude Patterns qualified for, 
were punched on IBM cards. 

The means and standard deviations were computed and 
rounded to the nearest whole number. It was thought that the 
calculation of variability measures, such as the standard devia- 
tion, from data coded into a few class intervals might involve 
appreciable grouping error. Standard deviations with Shep- 
pard’s correction (2) were calculated on several aptitude distri- 
butions. 

The differences shown in Table 1 in standard deviations, 
computed from grouped data and corrected by Sheppard’s cor- 
rection, varied from .2 to .4. The differences between the stand- 
ard deviations with and without Sheppard’s correction were 

1 William M. Smylie was responsible for planning the details of the statistical pro- 
cedures and analyses; and acknowledgement is made to Mr. Harris Weidner, Head of 
the IBM Unit, Research and Statisticics Section, Ohio State Employment Service, 
for his help and cooperation. 
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similar for all of the other aptitudes (differences of .a to .3 
predominantly). Since the standard deviations were being 
rounded to the nearest whole number, it was thought that 
Sheppaid’s correction does not appear to make any real differ- 
ence. The standard deviations of the aptitude scores were com- 
puted so that they could be compared with the standardized 


TABLE 1 

Means and Standard Deviations oj Aptitude Seotes for the Five Schools 






G 

V 


N 


S 


P 





M 

S D. 

M 

SD. 

M 

SD 

M 

S.D, 

M 

SD. 

School 1, N 


32 

109 

14 

IOO 

27 

1 12 

IS 

log 

l6 

114 

22 

School 1 , N 

= 

177 

. .. 119 

17 

III 

is 

ns 

17 

Il6 

19 

1 20 

l6 

School 3, N 

=a 

5° 

109 

13 

1 °s 

13 

107 

13 

117 

16 

118 

17 

School 4. N 

= 

67.. . . 

. . 112 

>5 

102 

15 

114 

IS 

ii 4 

18 

Il6 

1 4 

School 5, N 

SSB 

113 

....... 1 1 1 

16 

IOI 

1 6 

107 

17 

117 

18 

II s 

14 

All schools, 

N 

=■439 • • 


16 

106 

16 

113 

17 

1 16 

18 

117 

16 





Q 

A 

T 


F 


M 




M 

SD. 

M 

SB 

M 

S.D 

M 

SD. 

M 

S.D. 

School 1. N 

n, 

3 * 

107 

15 

102 

16 

IOI 

X8 

301 

16 

IOO 

1? 

School a. N 


177 ... . 

11a 

IS 

Il6 

IS 

109 

l6 

log 

i6 

114 

IH 

School 3, N 

a 

50 


17 

119 

l 6 

Il6 

IS 

ns 

19 

12 1 

18 

School 4, N 

= 

67 ... . 


l6 

107 

IS 

1 04 

IS 

106 

16 

1 13 

19 

School s, N 

== 

113 

102 

l6 

i °7 

13 

IOI 

16 

I03 

17 

1 12 

18 

All schools, 

N 

^ 439 

107 

l6 

III 

10 

I07 

16 

107 

17 

113 

17 


M S.D. 

All-school-all-aptitude no l6 


standard deviations in the original standardization of the 
battery. 

The means and standard deviations for each school, males 
and females combined, are shown in Table 1 . Sex differences in 
these aptitudes for these schools were only slight and not sig- 
nificant as far as this study is concerned. 

The all-school all-aptitude mean is no and the all-school all- 
aptitude standard deviation is 16. The mean is one-half a 
standard deviation higher than the mean of the population upon 
which this battery was standardized. This appears to be a 
reasonable result of the academic background of the group. The 
mean education of the working population used in the original 
standardization was eleven years. The education of the popula- 
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tion of this high-school group is, of course, held constant at 12 
years. The standard deviation of 16 for the high-school group 
is also to be expected since high-school seniors would be a more 
homogeneous group than the working population whose educa- 
tion ranged from six years through college graduation. 

Means and Standard Deviations 

The mean aptitude scores of each school are compared with 
the all-school all-aptitude mean to see how much the aptitude 
means of this selected group vary among themselves. Consider- 
ing the number of cases m each of the high schools, there is 
surprisingly little variability in mean aptitude scores or in 
standard deviations among the schools The two most obvious 
deviations are both for School 1 (N = 32). For this school Fac- 
tor V shows a SD of 27, and Factor P a SD of 22 This is quite 


TABLE 3 

Distribution oj S.D 's for the to Aptitudes in 5 Schools 


SD 

. , 27 

26 25 24 23 22 21 20 19 

18 

17 

16 

IS 14 

13 

Distribution. . . 

. . .1 

1 3 

6 

6 

14 

12 3 

4 


interesting considering the fact that high schools in different 
types of communities were included in this group. School No. 
i’s average mean aptitude was 106 with two aptitude means as 
low as 100. School No. 2’s average mean aptitude was 114 with 
one mean as high as 120. All other schools average mean apti- 
tudes were in between the average mean aptitudes of Schools 
No. 1 and 2. However, School No. 3 has one mean aptitude as 
high as 121. 

Table 3 shows the distribution of the standard deviations of 
all of the ten aptitudes of all schools . 

Except for the two highest sigmas, they all cluster rather 
closely about the mean sigma (16). 

Means and Standard Deviations by Age Groups 

The ages of the 439 students were coded into 13 class inter- 
vals of 3 months each. The 439 students were then divided into 
three groups based on the mean and standard deviation of the 
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three-months’ age groups and the mean age for each group was 
computed. There is two years of difference between Group I and 
Group III. Table 4 shows the mean aptitude test scores for the 
ten aptitudes for these three groups. 

The average difference between Groups I and II is .4 S.D.’s. 
The average difference between Groups III and II is .3 S.D.’s. 
With two exceptions (S and M), the mean aptitudes of Group I 
(18 yrs. 11 mos.) are below those of Group II. With one excep- 
tion (S), the mean aptitudes of Group III are above those oi 

TABLE 4 

Mean Aptitude Test Scores J or the Ten Aptitudes by Age Groups 

Group GVNSP QATFM 

Group I, 18 yrs. n mos,, N »=> 4a 105 94 103 117 113 99 104 100 106 113 

Group It. r7 yrs. 9 mos. , N «=» 364 114 ic6 113 116 117 108 1112 107 107 1x3 

Group III, 1 6 yrs. 11 mos., N *= 33 . . . 113 117 119 116 iaa 113 118 113 iro 116 


Group I =* - 4-1 sigmn and above inenn 
Group I Average Age 18 years, u months 

Group II « +1 sigma to — x sigma about mean 
Group II Average Age 17 years, 9 months 

Group III = —1 sigma and below mean 
Group HI Average Age 16 years, n months 

TABLE 5 

Differences {in S.D. units) between Groups I and III 


(S.D. - 16) 

G V NSPQATFM 


Differences between Group I (18 yrs. ix 1.1 1.4 1. .1 .6 .9 .9 .8 ,3 .1 

mos.) and Group III (16 yrs. 1 1 mos.) 


Males 

N =• 31 

Females 

N “ 11 

Total 

N •= 42 

Males 

N — 162 

Females 

N ■=■ 202 

Total 

N = 364 

Males 

N - 1 5 

Females 

N - 18 

Total 

N - 33 


Group II. The oldest group seems to be consistently below the 
mean on practically all of the aptitudes. This group may have 
enough students who spent more than the usual number of years 
in school, that is, those who are slightly retarded, to have a 
tendency to lower the mean aptitudes of this group. Group III 
(16 yrs. 11 mos.) may have enough of the younger seniors who 
have been bright enough to be allowed to skip grades or partial 
grades, to raise the mean aptitude scores somewhat. 

Table 5 shows the differences in standard deviation units be- 
tween the oldest group (I) and the youngest group (III). 
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The greatest differences are in the G, V, and N aptitudes 
which are the aptitudes more generally related to academic 
work. If the two extreme age groups are groups that have the 
widest difference in speed of learning, as has been suggested 
above, G, V, and N should have the larger differences. It is 
interesting to note that the S aptitude (Spatial), one test of 
which is also contained in G, has the lowest difference. 

Mean Aptitudes by Sex 

The mean aptitudes for all schools by sex were computed. 
These are shown in Table 6. 


TABLE 6 

Mean Aptitude Scores jor Males and Females 



G V 

N 

S P Q 

A 

r 

F 

M 

N = aog Male .... 

n8 105 

US 

121 115 102 

109 104 105 

116 

N = 231 Female .... . 

.III 106 

in 

III II9 312 

113 109 109 

III 

Difference 

7 1 

4 

30 —4 —10 

4 - 

s ■ 

“4 

s 


TABLE 

7 





Mean Aptitude Scores According to School Course 




School Course 


G 

V N S P 

Q A 

T 

F 

M 

Commercial , . 

.N = 8a 

106 

100 no 109 1 19 

114 1 1 2 

109 

107 

na 

Industrial Arts & Technical. 

N = 44 

109 

94 108 118 IJ3 

94 100 

93 

IOI 

”3 

Academic 

.N = 153 

1 IS 

I 15 120 122 120 

hi 115 

no 

107 

116 

General ... 

. N = 148 

III 

103 109 I I4 I l6 

104 112 

107 

109 

112 

Vocational Agriculture . 

,.N = 4 

108 

101 113 91 99 

93 9 a 

81 

86 

91 

Home Economics 

. ,N - 8 

94 

98 102 97 III 

107 97 

103 

104 

IOI 


From Table 6 it appears that there may be some sex differ- 
ences in aptitudes S and Q in this group. Perhaps high-school 
senior boys are a little better in S (Spatial Aptitude) than high- 
school senior girls. Also, perhaps senior girls are a little better 
in Q (Clerical Aptitude) than senior boys. Further data are 
needed to clarify this issue. 

Mean Aptitudes by School Course 
The mean aptitude scores according to school course for all 
schools are shown in Table 7. 

Senior students in commercial courses have Q (Clerical Per- 
ception) as their second highest mean aptitude. P (Form Per- 
ceDtion) is their highest mean aptitude. Senior students in 
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industrial arts and technical courses have S (Spatial Aptitude) 
as their highest mean aptitude. Seniors in academic courses 
have the highest G (intelligence) mean aptitude. Their N, S, and 
P mean aptitudes are 120 or slightly over. Their V (Verbal) 
mean aptitude is higher than the V aptitude of the seniors in 
the other courses. The above general findings are consistent 
with findings of other investigations. 

Occupational Aptitude Patterns by Course 

Table 8 shows the per cents of students in the Commercial, 
Academic, General, and Industrial Arts and Technical courses 
who had aptitude scores which gave them OAP’s (Occupational 
Aptitude Patterns) in the Clerical groups (Patterns 5, 8, 11, 12, 
and 19), and in the “College OAP’s’’ (Patterns 1, 2, and 3). 


TABLE 8 

Pei Cents of Students Acco) ding to Course Who Had Certain OAP's 



" *"■ 

Clerical 


Average 




OAP's 

OAP's 

Number of 
OAP's per 
Student 

Students 



S, 8, 11, 

12, 19 

1, 2, 3 

Receiving 
No OAP's 

Commercial Course 

N ■= 8 a 

a9% 

•+% 

IO 

O 

Academic 

General 

N — ijs 
.N «■ 148 

tk 

4- % 

• 7% 

9 

I 

O 

Industrial Arts 6t Technical. . . 

N -43 

11 % 

•7% 

6 

4 


The commercial course seniors qualified for the highest per- 
centage of clerical OAP’s. The academic course seniors qualified 
for the highest percentage of OAP’s I, 2, and 3. (It must be 
noted here that the GATB covers only a few of the college 
counseling areas.) The academic or college preparatory course 
seniors have the highest average number of OAP’s qualified for, 
and also stand second in percentage of clerical OAP’s qualified 
for. 


Summary 

This study was concerned with the general significance and 
considerations of the use of the GATB in a high-school counsel- 
ing program. It was thought that the GATB mean aptitude 
scores, standard deviations, and Occupational Aptitude Pat- 
terns were consistent with the “normal” expectation for this 
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group of high-school seniors The battery appears to be quite 
applicable for use with this type of population. 

Further research is needed to determine how well the test 
results have aided in the vocational adjustment of these high- 
school youth. An effort will be made to carry out this type of 
study. 
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INTELLIGENCE TEST SCORES AS INDICATIVE 
OF ABILITY TO LEARN 


J. W TILTON 
Yale University 

Introduction 

If one starts with the assumption that the most dependable 
measure of learning is secured by subtracting a measure of 
status before from one after the period of practice, study or in- 
struction, he finds himself in an arresting situation with regard 
to the definition of intelligence as the ability to learn. This is so 
because measured changes in score tend to be negligibly corre- 
lated with intelligence-test scores (a). What then shall we say 
about the validity of the use of intelligence- test scores in schools, 
and elsewhere, as indices of the ability to learn? Must we con- 
clude from this reported negligible correlation, in spite of a long 
period of use for that purpose, that intelligence-test scores are 
not indicative of the ability to learn? The position taken in this 
paper is not a categorical yes or no. The paper is not a full con- 
sideration of the topic. The emphasis in the paper is that the 
measures of learning which have provided the low correlation 
are not an adequate basis upon which to claim invalidation. 

Definition of an Adequate Criterion 

What are the qualifications for measures of gain, if they are 
to constitute a criterion for the validation of intelligence-test 
scores as indices of the ability to learn? 

First, the reliability of the measures of gain must be known, 
and should be as high as that for end-scores. This seems like a 
trite observation, but it seems to be needed. The tendency is to 
be satisfied with having used end-tests of acceptable reliability, 
and to let it go at that. To use reliable end-test scores is good, 
so far as it goes, but it is not enough. Even with the coefficient 
of reliability for the end-tests as high as .95, the reliability of the 
differences may be zero. The end-tests contribute only unre- 
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liability to the measures of differences. All you can say for 
reliable end-tests, is that the more reliable the end-tests, the less 
handicap there is to be overcome in the measurement of gains. 
How reliable the differences are depends chiefly upon what 
happens to change the pupils between testings. In other words, 
since reliability is the ratio of true variance to obtained vari- 
ance, the reliability of gains is a positive function of the differ- 
entiation, which learning introduces, and a negative function 
of error in measurement. 

The trouble in practice is that we do not wait for learning to 
introduce enough differentiation. We think we are doing well if 
we allow a whole school year to elapse between the initial and 
final tests. But even after a year, reliabilities of gains, for in- 
stance, on the parts of achievement-test batteries, are still low. 
Whatever the reliability is, it needs to be measured and re- 
ported. Without such information most measures of gain may 
be assumed to be very unreliable, and to show very low correla- 
tions with intelligence-test scores, or with any other independent 
measure, merely because of that unreliability. 1 

But for the measures of gain to be sufficiently reliable, or at 
least of known reliability, is not enough. A second requirement 
must be set up. If the measures of learning are to be used as a 
criterion, against which intelligence-test or other scores are to 
be validated, as measures of the ability to learn, something must 
be required of the learning situation. It must provide an oppor- 
tunity for each to learn according to his ability. 

Data with regard to spelling, reported by Carroll (i), illus- 
trate a situation in which such an opportunity does not exist. 
At the beginning of the year pupils were tested as to their ability 
to spell the words to be taught during the year. Had they been 
tested again at the end of the year, the brighter pupils could 
not have made the larger gams, assuming ioo per cent mastery, 
because they knew 81 per cent of the words at the beginning of 
the year whereas the duller pupils could spell only 40 per cent 
of them. The bright could gam only from 81 to 100 from the 
situation, while the dull could gain from 40 to 100. 

'Those not familiar with the substantial correlation which may be obtained be- 
tween initial or final test and gain ( 5 ) merely because of the correlation of errors are 
probably led erroneously to infer reliability from such correlations. 
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Gains obtained under such circumstances, where there are 
clear limitations of opportunity, are obviously not suitable as 
criteria of the ability to learn. It is quite possible that such 
limits are often present in the school situation, limited offering, 
because of the tendency to organize content into years and 
semesters, limited instructional help because of the pressure 
upon teachers to get about 95 per cent of the class above the 
required standard. At any rate, not all measures of gain are 
suitable to serve as criteria, even if satisfactory so far as re- 
liability is concerned. Intelligence-test or other scores may not 
be invalidated as indices of the ability to learn in situations in 
which the possibility of validation is curtailed. 

In the third place, and finally, the possibility of validation 
must be uncurtailed not only in the teaching or learning situa- 
tion, but also in the testing situation. It is not enough that each 
has the opportunity to learn according to his ability, he must 
also have an opportunity for the full amount of that learning 
to be reflected in the measure of gain. 

Here again, as in the case of reliability, the tendency is to 
err by assuming that if it is a good test it will give good measures 
of gain. But if the test is a good initial test (ranging in difficulty 
from o to 100 through a central tendency of 50 per cent) it will 
not be a good final test and will yield poor measures of learning. 
If a good distribution of measures of learning is to be obtained, 
it will not come from a good initial test but only from a good test 
for measures of learning. It can be secured only after the use and 
repetition of a wastefully long test. It will be made, presumably, 
of items ranging from o to 100 through 5° per cent difficulty. 
Only in this case, the difficulty to be examined is not beginning 
difficulty nor end difficulty, but difficulty in learning. Item 
analysis for this purpose will not be based upon the per cent 
answering correctly, but upon the per cent learning to answer 
correctly. Such an examination of the measures of gain would 
not alone provide sufficient assurance of the adequacy of the 
measures, but it would reveal some of the grosser inadequacies. 

These, then, are the qualifications for an adequate criterion 
against which intelligence or other scores may be compared, as 
indices of the ability to learn. For the measures of gain which 
have provided the published low correlations, the reliability 
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has not been determined, it is not known to what extent the 
opportunity to learn was curtailed, and, if the opportunity to 
learn was adequate, it is not known whether the tests permitted 
good measures of the learning. If the validity of status scores, 
as indices of the ability to learn, is to be checked, data are 
needed, and they need to be chosen specifically for that purpose. 

Two Attempts to Secure an Adequate Criterion 

There were, in the writer’s files, two sets of data which it was 
thought might yield satisfactory criterion-measures of learning. 2 
Both were in the social studies area, one at the seventh-grade 
level and one at the twelfth. The data to be reported here for 
the seventh grade are for a sample. The sample is composed of 
all cases with a full set of scores from 6 of the 9 control sections 
in an experiment. For the whole grade in the single junior high 
school, (N = 515), the mean Otis Group IQ was 100.0, the 
sigma was 22 .2. For the sample (N = 134), the mean and sigma 
were 102.9 an ^ ' 2 3' 1 ■ The sample is therefore fairly representa- 
tive of the whole seventh grade. The data to be reported for the 
twelfth grade are for the full twelfth grade in one high school, 
N = 156. 

The tests in the seventh grade were made for four 3 experi- 
mental units of instruction. They were composed of 300 items, 
and covered eleven weeks of instruction. The twelfth-grade test 
was the Columbia Research Bureau American History Test, com- 
posed of 200 items. The period covered was one school year. 

In each case most of the items were discarded. What was 
wanted, as stated above, was to be sure of differentiation as to 
learning with the least curtailment of opportunity. The choices 
were arbitrary. First, it was assumed that when fewer students 
answered an item correctly at the end of the period than at the 
beginning, the loss was a chance difference. Then all items were 
discarded unless the gain was larger than the largest loss. 
Second, it was assumed that if the abler students were being 
penalized in the full test, it was by the presence of items an- 
swered correctly at the beginning by a majority of the students. 

3 The seventh-grade date have been described by D. C Knowlton nnd J. W. Tilton 
(3). For the twelfth-grade data, the writer is indebted to Clarence H. Elliott, 

8 Units i, 3. 4, and 5. Unit 2 was discarded for the present purpose because of the 
relatively small gains made (3) Table 4, p. 42, 
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Arbitrarily, for the seventh grade, items were discarded which 
initially were answered correctly by more than 45 per cent. For 
the twelfth grade, for which a greater caution seemed advisable, 
all items were discarded if answered correctly by more than 25 
per cent at the beginning of the year. 

There remained for criterion tests of learning, 54 items for 
the seventh-grade sample, and 20 items for the twelfth grade. 
The 54 items ranged in learning difficulty from 7 to 83 per cent, 
averaging 34 per cent. The 20 items ranged from 18 to 58 per 
cent, with an average of 38 per cent. The reliability coefficients 
are .93 and .73, 


‘Dhe Use of Criterion Scores 

How well should intelligence-test scores agree with criterion 
measures of learning? What “passing mark” may be set, above 
which validity may be said to have been established? It is easy 
enough to agree that if the correlation is zero, validity has not 
been established. But is it reasonable to require the correlation 
to approach unity? There are two reasons why that would be un- 
reasonable. One is that the factors of interest and application 
are unaccounted for. The other is specialization of ability. It 
has not been assumed that intelligence-test scores are equally 
indicative of learning in all areas. A reasonable requirement is 
that the agreement between index and criterion should approxi- 
mate that between the index and initial status in the area of the 
criterion learning. 

This requirement is met in the seventh-grade sample and in 
the twelfth grade. The correlations for the seventh-grade Otis 
IQ are with initial .50 and with the learning criterion .49. For 
the twelfth-grade Terman Group IQ’s, the correlations are with 
initial .43 and with the learning criterion .49 4 

Discussion 

As it turned out, in these two cases the construction of cri- 
terion measures with selected items was in a sense a wasted 
effort. The correlations of IQ with gains using all items were 

4 Correction for attenuation does not alter the picture much. In this correction the 
reliability of the Otis IQ was estimated, the other reliabilities were computed The four 
corrected correlations in the order mentioned above are 58, 53, 56, and .58. 
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not reliably less than with the criterion measures. In other 
words, the gains on all items were proved to be good criterion 
measures, as they were — fairly reliable (.7 1 and .68), and ob- 
tained in a situation in which there was plenty of opportunity 
both to learn and to be measured. The criterion measures gave 
evidence of superiority only with respect to reliability, .93 for 
54 items as compared with .7a for all 300 items, and .73 for 10 
items, as compared with .68 for all of the aoo items. 

Conclusion 

It may be said that within the two sets of data described, in- 
telligence-test scores predicted learning fairly well. But this 
paper has been presented, not so much for the weight of the 
evidence presented, as to serve as a stimulus to similar reports, 
a plea for better data than are available. In hundreds of experi- 
ments, intelligence-test scores have been used in equating 
groups. The correlation between these scores and gains should 
be reported, with measures (or good estimates) of the extent to 
which the gains are suitable criteria. If intelligence-test scores 
are to be discredited as indices of the ability to learn, it must 
be done with more concern for defensible criteria than has been 
given to the problem. 
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A STUDY OF THE USE OF CERTAIN TECHNIQUES 
FOR REDUCING RESISTANCE DURING THE 
COUNSELING INTERVIEW 

STANLEY E. DAVIS 
Boston University 

AND 

FRANCIS P. ROBINSON 
Ohio State University 

Rapport between the counselor and client is important for 
the success of the counseling interview One might well ask: 
What can a counselor do to help to establish and to maintain 
rapport? What can he do to reduce client resistance if it 
occurs? We know that the general manner of the counselor 
and the client’s insight and motivation are important. We 
know also that counselors use many specific devices, e g , 
smiling, illustrations, etc., to help in putting their points across. 
This study, while not furnishing complete answers to these 
questions, represents a start in an analysis of specific techniques 
used by counselors in preventing or overcoming resistance. 

Before 1940 most of the writings on rapport in the counseling 
interview were of a theoretical nature or represented summaries 
of experience in counseling, but few were based on experimental 
study. Since 1940 there have been a few experimental and 
statistical studies of the counseling interview, among which are 
the studies made by Porter (4), Snyder (6), Sherman (5), 
Tindall and Robinson (7), Allen (1) Carnes (2), and Daulton 
(3). None of these studies has been directly concerned with 
discovering specific techniques that a counselor may use to 
establish and maintain rapport. It is in this direction that the 
present study points. 

Source of Materials 

The materials for this study consisted of typescripts of 
recorded counseling interviews, made at the Ohio State Uni- 
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versity. The interviews were between students enrolled in a 
course on "Study Skills and Effective Adjustment” and their 
counselors, some of whom were advanced students of psychol- 
ogy, while others were members of the Department of Psy- 
chology who had had considerable counseling experience with 
students. The recordings of the counseling interviews were 
made with the full knowledge and consent of both persons 
concerned. These clients represent the normal, not-too- 
disturbed young adult seeking help on problems of study skills, 
vocational planning and of a personal nature 1 Their problems 
of resistance represent normal reticence in discussing their 
problems and hesitancy in wanting to change their ways; 
problems of resistance from unconscious repression and trans- 
ference were not present to any great extent. 

Judging Rapport 

The necessary first step in this study was to determine a 
method of judging the degree of rapport in an interview from 
the typescript of that interview. Since rapport is likely to be 
dynamic, changing quite suddenly at some times and gradually 
at other times, the measurement of rapport is a difficult prob- 
lem. Because the dynamics of rapport are frequently more 
apparent in groups of responses than in single response, it 
seemed feasible to use a unit longer than a single response for 
the rapport ratings; and because the degree of rapport may 
change several times within a counseling interview, it was 
decided to use as units something between the single response 
and the entire counseling interview. 

Sherman’s (5) system of division into units according to 
topic of conversation was adopted for this purpose. A new 
unit starts and ends when the topic of conversation changes. 
The 68 available interviews by 0.1 counselors were divided into 
units on the basis of four topics . study-skill problems ; scholastic, 
non-skill problems; vocational problems; and therapy. 

After the interview units had been thus determined, the 
next step involved rating the rapport in each discussion-topic 

]A more complete account of the remedial study-skills program and the counselor 
training program may be obtained from the following article: Francis P. Robinson, 
“Two Quarries With A Single Stone,” Journal of Higher Education, XVI (1945), 
eoi-aod. 
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unit on a scale of i to 5, the definitions of which are given 
below, 

1 Counselee definitely resistive — rejects counselor point of 
view or manner of structuring interview in a somewhat 
belligerent manner, refuses to talk about a real problem or 
attempts to close interview. 

2. Counselee somewhat resistive — rejects counselor point of 
view or suggestion but in a polite manner, does not talk 
freely, or may show a tendency to contradict counselor. 

3. Counselee apathetic — takes no initiative but accepts counse- 
lor suggestions, usually in a non-committal fashion. 

4. Counselor and counselee work together fairly well — talk 
together rather freely, although there may be some friendly 
parrying to advance points. 

5. Counselor and counselee work together on a real problem — 
talk very freely, feeling of mutual respect is marked 

The units with ratings of 1, 2, and 3 were designated as having 
Low rapport, and those with ratings of 4 and 5 as having high 
rapport. 

‘ Techniques of Leading 

What influence do leading techniques used by the counselors 
have upon their choice of resistance-reducing techniques? 
That is, a counselor’s remark may do no more than to indicate 
acceptance of what the client has said, or the counselor may 
suggest some points for tentative consideration, or he may 
urge that a new idea be accepted. We are interested in finding 
if these resistance-reducing techniques tend to be used more 
often when the counselor does most of the leading. Every 
counselor remark in a unit was classified as to its degree of 
leading and the technique used most frequently in the unit, i e , 
the “primary technique,” was determined. Units character- 
ized by the following four primary techniques occurred fre- 
quently enough to be used in this study. These definitiQns are 
arranged in order of increasing amount of leading : 

Clarification: The counselor states the feeling or problem of 
the counselee in such a way that it can be more clearly under- 
stood and used in the interview, but he does not interpret 
the counselee’s feelings or problem, nor does he add informa- 
tion or any suggestion of his own. 

Tentative Analysis: The counselor verbalizes his conception of 
the meaning of the response or series of responses of the 
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counselee but allows the counselee complete freedom con- 
cerning the acceptance or lejection of that interpretation. 

The counselor is not attempting to push the counselee to- 
ward a preconceived idea of insight, but is setting up ideas 
for the counselee to examine. 

Interpretation: The counselor verbalizes his conception of the 
meaning of the response or series of responses of the coun- 
selee and attempts to push the counselee toward the counsel- 
or’s idea of insight through the logic of the data. Frequently 
the counselor attempts to maneuver the counselee into a 
position where the counselor’s advice becomes the only 
alternative. 

Urging the Acceptance of Advice: The counselor gives advice 
to the counselee and urges his acceptance of it. Sometimes 
the counselor only suggests a course of action, but the 
"should” is very clearly implied and usually stated by the 
counselor. The counselor’s values are involved here. 

Selection of Units 

After the available interview typescripts had been analyzed 
according to topic of conversation, degree of rapport, and lead- 
ing techniques used, the next step was to select certain of the 
classified interview units for statistical analysis. The following 
numbers of units were desired: i) 25 units with low rapport of 
each of the four topics; 2) 0.5 units with high rapport of each of 
the four topics; 3) 25 units with low rapport of each of the 
four leading techniques; 4) 25 units with high rapport of 
each of the four leading techniques. The same 100 units could 
satisfy specifications 1 and 3; another 100 units could satisfy 
specifications 2 and 4. The total number of units would be 
200. It was also desired to obtain units representing a wide 
spread of counselors and counselees. Within the framework 
of these considerations, the interview units were chosen at 
random. 

It was found, however, that the desired numbers of units 
were not available in every case; only 19 Therapy units with 
low rapport and 11 Vocational-Problem units with low rapport 
were available. In all, 180 interview units were used, repre- 
senting more than twenty counselors and as many counselees. 

Resistance-Reducing 1“ echniques 

The next part of this study consisted of analyzing a large 
number of counselor responses to find any special techniques 
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used by the counselors to reduce resistance or increase rapport. 
The interview units used for this analysis were not used again 
in the study proper. Thirteen counselor techniques were 
found that apparently had some effect upon rapport. Later 
analysis of the selected 180 units showed that this list covered 
the techniques used. These techniques will be called “resist- 
ance-reducing” or “secondary” techniques. 

Sympathy: The counselor sympathizes with the counselee, i.e., 
says or implies that he feels sorry for the counselee. 

Assurance: The counselor encourages the counselee by saying 
or implying that the counselee’s problem will be solved. 
The counselor’s purpose in using this technique is to ease the 
counselee’s fears. 

Approval: The counselor expresses approval of or agreement 
with something that the counselee has said or done The 
approval is usually, though not necessarily, intended to 
encourage the counselee. 

Humor : The counselor attempts to ease the tension in the mind 
of the counselee by saying or implying something intended 
to make the counselee laugh. However, the mere fact that 
the counselee laughs following a statement by the counselor 
does not necessarily indicate that humor was intended by 
the counselor Nor does the fact that the counselee does not 
laugh necessarily indicate that the counselor did not intend 
humor 

Objective Materials Used: The counselor makes use of some 
objective materials during the interview, such as notebook, 
textbook, chart, diagram, etc 

Counselor Makes Personal Reference: The counselor tells 
about some of his own experiences to illustrate his point, or 
refers to himself in such a way as to insert his own person- 
ality into the interview by saying, “I think,” “I would do 
this,” etc. 

Illustration or Anecdote (non -personal) : The counselor cites 
an example of the experience of another person or a state- 
ment made by another person to illustrate his point. This 
classification includes “telling a story.” This is a non-per- 
sonal reference. 

Question Form: The counselor makes a tentative statement of 
fact or opinion or interpretation of the counselee’s previous 
statement or statements in the form of a question, giving 
opportunity for the counselee to agree or disagree with the 
counselor. Mere asking for information is not included in 
this category. The counselor’s purpose in asking the ques- 
tion may be to cause the counselee to think further about his 
problem. 

Counselee’s Words Used as a Springboard: The counselor fol- 
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lows the counselee’s lead, repeating the counselee’s state- 
ment and using it as the beginning of a new topic for discus- 
sion 

Threat: The counselor says or implies to the counselee that 
unpleasant results for the counselee are likely to occur if the 
counselee follows or fails to follow a certain specified course 
of action. 

Experimental Findings Cited: The counselor cites some experi- 
mental evidence to illustrate or prove a point 

Expression of Surprise: The counselor expresses surprise or 
astonishment at something that the counselee says or does 

Irony: The counselor makes a statement which is apparently 
intended to convey the opposite meaning. Usually, but not 
necessarily, the irony is used in a derogatory sense. 

Reliability 

The reliability of the system of classification by secondary 
techniques was determined in two ways: 

I. Reclassification more than a month later 

i, Classification by two independent judges, both advanced 
students of psychology 

A rank-order coefficient of correlation of .95 was obtained 
between the first and second classifications. The rank -order 
coefficients with the judges ranged from .81 to .92.. 

Analysis of Data 

After the interview units to be used in this study had been 
chosen, the first question that arose was: 

1, Were certain secondary techniques used more frequently 
than others, or did they seem to occur in a random fashion? 

To answer this question each counselor response in the 180 
units was classified according to one of the thirteen secondary 
techniques or as “unclassifiable.” It was found that certain 
of the techniques were used significantly more frequently than 
others, in the following order of occurrence: question form 
(764 times); personal reference (557 times); approval (167 
times); assurance (148 times); non-personal illustration (105 
times); humor (61 times). Each of the other techniques was 
used quite infrequently — ten times or less. Frequency of oc- 
currence does not necessarily indicate the desirability of any 
technique, but merely what techniques the counselors in this 
study liked to use. Some counselors seemed to have favorite 
techniques. 
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Knowing that these secondary techniques apparently did 
not occur at random, and knowing that some occurred signifi- 
cantly more often than others, the writers wanted to make a 
start toward determining the effects of the secondary counseling 
techniques upon rapport. The question was asked: Did the 
frequencies of occurrence of each of the secondary techniques 
in units of high and low rapport differ significantly? The 
following techniques occurred significantly more frequently in 
low rapport units; the corresponding chi-squares and levels of 
significance are also given: 

Assurance: chi-square equaled 4.7633, or 3 per cent level of 
significance 

Personal reference: chi-square equaled 5 0554, or 3 per cent 
level of significance 

Non-personal illustration: chi-square equaled 8.9285, or 1 
per cent level of significance 

The other techniques showed no significant differences in 
occurrence. At first thought it might be assumed that, because 
the use of resistance-reducing techniques should result in in- 
creased rapport, they should occur more frequently in the 
better discussion units. On the other hand, another factor is 
working here: a counselor is most apt to use these techniques 
when rapport is breaking down. The above results and dis- 
cussion indicate that it is difficult to determine the relative 
effectiveness of resistance-reducing techniques by their com- 
parative frequency of occurrence in units of good and bad 
rapport. 

1, Does the topic of conversation in the interview units 
appear to have any effect upon the frequency of occurrence of 
each of the various secondary techniques? The techniques of 
assurance, humor, personal reference, and non-personal illus- 
tration were used most frequently in therapy units. The 
differences noted were significant at the 1 per cent level, except 
for assurance whose difference was significant at the 5 per cent 
level. Since therapy units are usually concerned with more 
personal problems than are other types of units, and are there- 
fore more prone to arouse resistance, it appears that the 
counselors used more secondary techniques the more resistance 
they expected. It seems, then, that the topic of conversation 
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has some effect upon the frequency of occurrence of the various 
secondary techniques. 

High and low rapport units for a particular topic did not 
show many unique differences. As for all of the units, units 
of low rapport within a topic tended to have greater use of 
these secondary techniques. The only exception was Ap- 
proval which was associated with high rapport in Vocational- 
Prohlem units. This difference was significant at the 1 per 
cent level. This probably occurred because counselors tend 
to use approval when clients make vocational plans which are 
most apt to be made in tiie more successful interviews. 

3. Do the techniques of leading used by the counselors seem 
to have any effect upon their choice of secondary techniques? 
Three of the secondary techniques, assurance, personal refer- 
ence, and non-personal illustration, were used most often in 
conjunction with the most pronounced techniques of leading, 
i.e., interpretation and urging. These differences were signifi- 
cant at the 1 per cent level. All other differences were not 
significant. These findings indicate that counselors tend to 
use secondary techniques most frequently when they use tech- 
niques of leading that might cause resistance. 

In addition to this statistical analysis, a small intensive 
study was made of twelve interviews units selected at random 
from the 180 units used in the study. The use of primary and 
secondary techniques and the dynamics of rapport in those 
units were carefully analyzed by a study of each individual 
counselor and counselee response. This analysis showed that 
the resistance-reducing techniques occurred most frequently 
at the time a strongly leading remark was made. It also 
seemed that the counselors used secondary techniques to help 
out when the rapport was at a low level, hence the more fre- 
quent occurrence of the secondary techniques in low rapport 
units. In addition, it seemed that the counselors used the 
secondary techniques frequently when they anticipated resist- 
ance from the counselee either because of the topic under dis- 
cussion or because of the amount of leading. 

Summary of Findings 

I . Counselors vary in the frequencies of their use of devices 
for reducing client resistance. Question form, personal refer- 
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ence, approval, assurance, non-personal illustration, and humor 
were used most frequently m the order of their mention The 
other techniques were used quite infrequently. Frequency of 
use, however, cannot be taken as a measure of relative effective- 
ness. 

i. The counselors' use of secondary techniques varied 
significantly with topic of conversation. The greatest use of 
secondary techniques was in therapy units, which were con- 
cerned with more personal problems of the counselees than the 
other types. 

3 The counselors’ use of secondary techniques varied 
significantly with the leading technique used. Some light was 
thrown on this by an intensive study of a smaller sampling of 
units. Counselors tend to use secondary techniques more often 
when they use strongly leading techniques than when they use 
techniques not involving much leading. 

4. While there were not many significant differences in the 
use of secondary techniques with units of high and low rapport 
of the various topics of conversation and techniques of leading, 
most of the significant differences were in favor of units of low 
rapport. Apparently the counselors used secondary tech- 
niques when they were most needed, but these secondary 
techniques were not effective enough in themselves to make the 
units end with above-average rapport. 

In general, this study has shown what resistance-reducing 
techniques counselors use and when they use them, rather than 
what techniques are most effective. The high frequency of 
some techniques for certain counselors suggests that the pat- 
tern found may be due in large part to trial-and-error develop- 
ment of counseling method More detailed studies of the 
interview will be needed before it will be known what tech- 
niques are most effective. It seems that the next step in this 
direction might be a study involving a careful analysis of each 
individual counselor response for secondary or resistance- 
affecting techniques used and of each counselee response for the 
degree of rapport. That is, a knowledge of the degree of rap- 
port following the use of each secondary technique would be 
of great value in the attempt to find supplementary counseling 
techniques that will help to promote good rapport between the 
participants in a counseling interview. 
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FRIENDSHIP CHOICES OF UNIVERSITY 
WOMEN STUDENTS 1 


M CATHERINE EVANS and MARGARET WILSON 
Indiana University 

The college residence hall offers a unique opportunity for 
fostering the social adjustment of the students who reside in it. 
As counselors we need more knowledge of group dynamics to 
aid us in setting up an effective program of social education. 

The Moreno sociometric technique makes possible the analy- 
sis of the relationships of individuals within a group. The frame- 
work of group organization can be analyzed by this technique, 
and cliques, cleavages, and persons dominant or isolated in the 
group structure can be identified. In this study the sociometric 
technique was employed to explore factors that contribute to 
friendships among college women. 

The 148 students living in one of the residence halls at In- 
diana University were studied. The majority of these students 
were freshmen. The class distribution was 90 freshmen, 19 
seniors, 32 juniors, and 7 sophomores. The hall had been 
occupied by upperclass women the preceding year, and most of 
the juniors and seniors had lived together for at least two years. 
The freshmen and sophomores were new to the hall that aca- 
demic year. 

At a general house meeting in the spring of 1946 the students 
were asked to respond to the following sociometric test: “Please 

list the names of your best friends among the students in 

Hall. Limit the list to not more than ten names.” These friend- 
ship choices were then tabulated according to factors that might 
be related to student choices. This article reports only three that 
showed a high relationship, namely, geographical proximity, 
class in the university, and religion. 

Proximity and ease of contact certainly contributed to the 

1 The authors wish to acknowledge the assistance of Miss Emily Taylor, Dean of 
Women at Northern Montana College, in the early stages of the study. 
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development of friendships. For example, roommates usually- 
listed each other as friends: almost 90 per cent of the students 
in double or triple rooms reciprocated friendship choices with 
their roommates. Eight more students listed their roommates 
as friends, but their roommates did not reciprocate their choices. 
Only one pair of roommates mutually ignored or rejected each 
other. It should be mentioned that some roommate changes 
had been made during the year. A complete list of these re- 
assignments was not available, but 16 changes of roommate 
pairs were known. Twenty-seven of the 3a individuals involved 
in these changes failed to list their former roommates among 
their friendship choices. 

With the exception of the few cases mentioned, close associa- 
tion as roommates had fostered friendship. It is true that the 
original roommate assignments had been carefully made. The 
small group of upperclassmen had, with few exceptions, selected 
their own roommates, but the freshman assignments had been 
made on the basis of information on the hall application blank. 
The counseling staff had endeavored to match roommates on 
such factors as socio-economic status, mutual interests, religion, 
size of community and high school, and age. Any statement as 
to the influence of roommate association in the development of 
friendships must be limited by the condition that original room- 
mate assignments are carefully made in an effort to match 
students who seem to have similar backgrounds. 

Proximity as a factor in the formation of friendships also was 
confirmed by the fact that the majority of choices were made 
by students living on the same floor. The hall in which the study 
was made has three floors of student rooms. The first floor is 
divided by the living rooms and reception hall into two corridors 
which house 14 and 10 students. There were 61 and 53 students 
on the second and third floors, respectively. Sixty-nine per cent 
of all the friendship choices were made intra-floor. The third- 
floor students made 73 per cent of their choices from that floor, 
while the first-floor students who were geographically separated 
into two corridors were the least closely knit group. 

The effect of proximity in the fostering of friendships was 
further illustrated by the tendency of students to form more 
friendships with students on the adjacent floor rather than on 
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more remote floors. The smallest number and percentage of 
choices were made between the first and third floors. Only 30 
choices were made by the 34 first-floor students from students 
on the third floor, and 36 choices by the 53 third-floor students 
from the first floor. In contrast, the first-floor group made 73 
choices from the second floor, and the third-floor students gave 
69 choices from the second floor. Likewise, the students on the 
second floor averaged at least one choice per student from the 
first and third floors. 

The students’ class in the university also was an important 
factor in the formation of friendship. The freshman women 
tended to choose freshmen as friends with 78 per cent of their 
choices made within their class. The junior and senior women 
had lived together the preceding year, and many friendships 
had developed between these two classes Actually 82 per cent 
of the 365 friendship choices made by the juniors and seniors 
were given to members of their own classes. There seemed to be 
a cleavage between these two upper classes and the freshmen. 
The juniors and seniors gave only 55 or 15 per cent of their 
choices to the 90 freshmen. Likewise, the freshmen made only 
28 or 4 per cent of their choices from seniors and 96 or 14 per 
cent from juniors. The small number of sophomores in the study 
makes it impossible to draw conclusions regarding their group 
or class consciousness. 

In the original roommate assignments an effort was made to 
assign freshmen as roommates and, likewise, upperclassmen as 
roommates. In fact, only 12 freshmen had upperclass room- 
mates, but these mixed class assignments had been fairly suc- 
cessful. All but one of these freshmen and three of the upper- 
classmen included their roommates in their list of friends. Only 
one of the 16 known roommate changes of the year had involved 
an original assignment of freshman and upperclassman. This 
same upperclassman was reassigned another freshman room- 
mate, and they reciprocated friendship choices. Obviously, 
class was not the factor in the lack of satisfaction of this upper- 
class woman with the original assignment. 

One possible explanation of the apparent cleavage separating 
the juniors and seniors from the freshmen is the satisfaction of 
the upperclassmen with the friends which they had made during 
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the preceding academic year. Apparently they felt slight stimu- 
lus to spread their friendships to new students in the hall be- 
cause of this satisfaction. The success of most of the mixed-class 
roommate assignments illustrates that friendships do develop 
between freshmen and upperclassmen when they are thrown in 
close contact and proximity to each other. However, class in the 
university was a significant factor in the formation of friend- 
ships. 

The religion of the student was considered in original room- 
mate assignments, and an effort was made especially to match 
Jewish, Catholic, and Christian Science students as roommates. 
The friendship choices of these three religious groups were 
explored for objective evidence of the importance of their reli- 
gion in the formation of friendships. 

There were 13 Jewish women among the 148 students in the 
hall. Five pairs or 10 of them were matched as roommates, and 
three of these pairs reciprocated friendship choices. One of each 
of the other two pairs chose her roommate as a friend, but the 
choice was not reciprocated. Three girls had non-Jewish room- 
mates at the time of the sociometric study, and two of them 
reciprocated friendship choices with these roommates. Two of 
these three had been assigned Jewish roommates originally, and 
both ignored the former roommate in the list of friends, al- 
though one of them was chosen by her former roommate. In 
general, the matching of Jewish women as roommates seemed 
successful with eight of the 10 matched, thus listing their room- 
mates as friends. 

The 13 Jewish students made a total of 83 friendship choices 
with 38 or 46 per cent of them given to their own group. They 
received a total of 56 non-Jewish choices. In other words an 
average of a. 9 Jewish choices and of 4.3 non-Jewish choices were 
received per student and there was an average of 3.5 choices 
made to non-Jewish students by each Jewish student. 

There were striking differences among individual Jewish stu- 
dents. The circle of friends of Student M was completely out- 
side the Jewish group. She reciprocated friendship choices with 
seven non-Jewish students, and she chose no Jewish girls as 
friends. Another student, G, listed two Jewish friends and eight 
non-Jewish friends. She received friendship choices from four 
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Jewish girls and n non-Jewish girls. This young woman was an 
accepted member of the Jewish group, but she had a wide cir- 
cle of friends among the non-Jewish students in the hall. The 
most popular member of the Jewish group, Student A, was 
listed as a friend by eight of these 13 girls. She chose only one 
non-Jewish girl as a friend, but she was listed by four of them. 
Actually, this popular student held a prominent position in 
both hall and campus activities and had wide contact with 
students. 

It is difficult to generalize on the basis of these data. Cer- 
tainly the Jewish students were well accepted by other students. 
On the average, each one of them had more non-Jewish than 
Jewish friends, but of course the non-Jewish students greatly 
outnumbered the Jewish students. There was, however, a rather 
close degree of unity within the group with the exception of 
the one student who had withdrawn completely There was 
evidence that the assignment of Jewish roomates was success- 
ful in a majority of cases. 

There were 18 Catholic students in the hall Four pairs of 
them were matched as roommates at the time of the study, 
and each one of these eight students chose her roommate as a 
friend. Two other Catholic girls had been assigned as roommates 
in September, but each now had a non-Catholic roommate. 
Each one ignored the former roommate in listing her friends, 
but each reciprocated friendship choices with the present room- 
mate. Seven other Catholic girls had Protestant roommates, 
and six of them reciprocated friendship choices with these 
roommates. The other girl was chosen by her Protestant room- 
mate, but she, however, ignored the Protestant girl. The re- 
maining student had been assigned a non-Catholic roommate 
in September, and they had disagreed. She had a single room 
at the time of the study. The matching of Catholic girls was 
successful in four out of five pairs originally assigned, but the 
matching of Catholic girls with Protestants was equally success- 
ful with eight of ten such assignments satisfactory to both room- 
mates concerned. Obviously, in the original room assignment, 
as stringent effort had not been made to match Catholic girls 
as in the case of Jewish students. 

The Catholic girls made a total of 131 friendship choices 
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with 19 or 15 per cent of them given to their own group. They 
received a total of 114 non-Catholic choices. In other words, 
an average of one Catholic choice and of six non-Catholic 
choices were received per student. There was an average of 
six friendship choices made from non-Catholic girls by each 
Catholic. Comparatively they made and received many more 
friendship choices from non-Catholic than Catholic students, 
but again the number of Catholic girls is small in comparison 
to the total group, 

It is evident from the preceding data that there was less 
unity in the Catholic than in the Jewish group. The degree of 
cohesiveness in each group also was expressed in terms of the 
index of interaction. The formula for this index is: 

100 (Number of Reciprocated Choices pl us N umber of Choices Given) 
Number 2 — Number 

The index of interaction for the Jewish group was 24.3 per cent 
in contrast to only 6.2 per cent for the Catholic group. The 
Jewish group was more tightly knit than the Catholic group. 

There were only five Christian Science students, and none 
of them was matched as a roommate to another Christian 
Scientist. While two of them named each other on their friend- 
ship lists, there were no other choices made among the group. 
Certainly there was no evidence that Christian Science stu- 
dents are unified by the bond of a common religion to the extent 
that it fosters friendships. If this group of Christian Science 
students is typical, no effort needs to be made to match stu- 
dents of this religious group. 

The study has confirmed the importance of proximity, of 
class in the university, and in some instances of religion in the 
formation of student friendships. Other factors were explored 
in the original study, but only the more significant results have 
been reported here. The sociometric technique offers an effec- 
tive method of determining factors in the choice of friends. It 
is equally effective in studying other forces in group relation- 
ships which have value to the personnel worker. 



THE ROLE OF RESEARCH IN IMPROVING 
STANDARDS FOR COUNSELING AND 
GUIDANCE SERVICES 1 


DONALD E. BAIER 2 
Personnel Research Section, A.G.O. 

Interest in and effort aimed at improved standards for 
counseling and guidance services have been increasingly 
apparent since the end of World War II. The last national 
meetings of the American Psychological Association (i) and 
The National Vocational Guidance Association (5, 6) (7) re- 
flected this fact. Shartle (a), Darley et al. (3), and others (4) 
have published discussions of some of the important aspects 
which have attracted attention. Among the topics which have 
received more than passing notice are Improved Standards 
through State Certification Requirements, Improved Standards 
through Certification by Professional Societies, Improved 
Standards through Organized Cooperative Effort in Training, 
and Accreditation of Counseling Services. Important as these 
aspects may be, they should not be permitted to obscure the 
role of research in improving standards for counseling and 
guidance services. 

In the last analysis improvement in the standards for 
counseling and guidance service depends primarily on the 
individual counselor, the knowledge he possesses, and how he 
uses it. The major problems, then, center on the selection, 
training and evaluation of the individual counselor. 

Reference has been made to current and projected procedures 
for selection by professional or legal certification; improvement 
through standards for training of the individual; and evaluation 
of the agency. As interim measures, these procedures and 
standards may be necessary, but I suspect that their authors 

1 The opinions contained herein are those of the author and do not necessarily reflect 
the views of the Department of the Army. , , , . 

« While he accepts full responsibility, the author desires to acknowledge the valuable 
comments of Dr. Mitchell Dreese of George Washington University 

313 



314 EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT 


would be among the first to admit that more objective valida- 
tion. of them is highly desirable. 

As in any other selection research, a task of first importance 
is to make an exhaustive study of what those to be selected and 
trained do, in order that valid criteria of the effectiveness of 
their training and performance may be developed. A start has 
been made ( 2 ), but much more extensive and intensive research 
on the ramifications of the profession of counseling and guidance 
is needed. Detailed job schedules showing for every variety of 
counseling the what, when, where, how, and why, would con- 
tribute immeasurably not only to the development of per- 
formance standards, but to clearer definition of necessary and 
desirable training content. Jager (5) has suggested the im- 
portance of adequate, detailed information about what coun- 
selors must know and do on the job to make more effective 
cooperative efforts to improve counselor training. 

The importance of detailed knowledge about the conditions 
and requirements of job performance in formulating training 
programs has been brought home to the Army most forcibly. 
Take a specific example: Prior to the establishment of the 
Army’s occupational research program, training of the typical 
infantry soldier was designed to give him skill in the use of his 
rifle and in one of the six other weapons employed in the 
infantry company, i.e., automatic rifle, light mortar, heavy 
mortar, anti-tank gun, light machine gun or heavy machine 
gun. Scientific job study of what the infantry-man actually 
does and needs in combat has shown the complete unreality of 
this program. It is literally a matter of life or death for the 
infantry soldier to have a sufficient knowledge of all of these 
weapons to enable his using them in an emergency. The 
priority of employment of these weapons changes with the 
tactical situation and survival may depend upon the ability of 
those who are left to seize and use the weapons of greatest 
current importance dropped by the casualties. The modifica- 
tions in Army training dictated by these findings have of course 
been made. Examples of this sort could be multiplied. 

Selection should take place both prior to and during the 
training phase and should continue well after full-time employ- 
ment is entered so that research to develop valid criteria of 
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performance in training as well as on the job is important. Job 
analysis should not only contribute to a greater objectivity in 
determining curriculum content for counselor training, and 
standards of later job performance, but should also facilitate 
better “engineering” of the jobs in the occupations of counseling 
and guidance. Some of the conflict of opinion about what 
constitutes appropriate training and standards may be resolved 
when the inter-relations among jobs, that is the feasibility and 
reality of a hierarchy in the occupation, emerge from research 
on counseling jobs. Another example from the Army may 
clarify what is meant here. In peacetime when the mission, 
strength, and pace of the military establishment are greatly 
reduced, many of the jobs in the Army are broad in scope; 
training is aimed at developing every soldier’s knowledge and 
skill so that he is capable of performing a wide variety of tasks. 
Ideally the automotive mechanic is trained to effect any kind of 
repair on any vehicle. His job requirements demand broad 
training and job experiences. When war demands the speediest 
possible mobilization and training, on the other hand, Army 
jobs and training are “shredded out” as the Army’s job analysts 
describe it. The job of automotive mechanic gives way to a 
whole series of jobs; automotive electrician, carburetor special- 
ist, brake specialist and so on. Content and standards for 
training and job performance can be varied as requirements 
dictate because adequate data about the tasks and jobs com- 
posing the occupation have been secured through research. 
How much and what kind of training and experience should be 
required in order to qualify for a particular kind of counseling 
certificate could be agreed upon more readily if the precise 
kinds of knowledges, skills, and activities embraced by it were 
spelled out. 

Research techniques could contribute not only to the training 
of individual counselors through clearer definition of knowledge, 
skill and job demands. If applied to the methodological 
problems of training, they should provide research answers to 
important questions of curricular organization and presenta- 
tion. For example, should the approach to the curriculum be 
functional? That is to say, shall what is taught and the 
manner of its teaching be dictated by the uses for it which the 
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future counselor will encounter? Should exposure to real 
guidance and counseling problems and situations be con- 
current with, or follow a long period of formal training? In 
what order should required knowledge and skill be presented 
using what methods in each instance? 

Answers to other important questions related to selection and 
evaluation might become more evident. To what extent 
should standards of performance in training weight the ability 
to recognize or reproduce information and techniques, as con- 
trasted with the skill in evoking a desirable outcome in real 
counseling situations? What are the inter-correlations be- 
tween performance in various counseling situations, personal 
characteristics of the counselor, breadth and depth of formal 
knowledge and skill and so on? To what extent are there 
critical knowledges, skills or personal characteristics without 
which little or no success in any phase of counseling can be 
attained, which therefore indicate non-acccptance for or dis- 
continuance of training for the profession? In the training of 
all types of counselors should substantial accent be placed on 
the development of a research attitude and competence in 
identifying and undertaking research problems in counseling 
and guidance? 

The feasibility of obtaining research answers to many of these 
questions hinges on the success in developing valid criteria of 
performance in counseling situations. Interim answers based 
on the pooled judgment of carefully selected qualified experts 
may have to serve immediate needs and doubtless represent 
real progress. However, the health and status of any pro- 
fession are, in the long run, proportional to its ability to render 
service which can be demonstrated to be effective and im- 
portant. The more difficult it is to distinguish between the 
more and the less effective in any professional group, the greater 
is the urgency of research efforts to develop evaluative tech- 
niques yielding results whose significance can be grasped 
readily. 

That the assessment of an exceedingly complex performance 
need not be confined to individual or group subjective judg- 
ments is suggested by several studies. These studies indicate 
that objective statistical summarization of a number of 
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variables can provide an assessment 0/ performance which is 
more reliable than any single judge’s subjective estimate; 
just as reliable as the estimate of a group of competent judges 
and much easier and less costly to obtain. While the criterion 
problem in the case of counseling activities is undoubtedly most 
difficult, some progress appears possible through intensive 
coordinated research Attempts must be made unless counse- 
lors are to be judged, rightly, as unwilling to apply to them- 
selves the scientific research approach basic to many of the 
tools they employ. Selection, training, and certification tech- 
niques for counseling and guidance personnel and agencies 
must be subject to rigorous validation, not merely against 
standards of prescribed training and facilities, however carefully 
determined by experts, but against job performance. 

I do not mean to imply that the need for validation by 
follow-up studies has completely escaped notice. Efforts have 
been made to compare actual outcomes with those developed 
by the counselor and counselee in the course of the process of 
counseling and guidance. But claims for the effectiveness of 
the individual counselor or agency or for counseling as a pro- 
fessional activity, would command more widespread attention 
and acceptance if research data were being systematically 
accumulated and published on a large scale. It is in this 
connection that mention was made earlier of the possible 
desirability of including among the objectives of counselor 
training, the development of a research attitude toward counsel- 
ing and guidance. 

The author’s Army experience has convinced him of the 
great value of organized, integrated, cooperative, personnel 
research programs, In the long run a comprehensive, organized 
research attack on the manifold problems of the counseling and 
guidance profession will be the best avenue to effective selection, 
training, and evaluation of its members and agencies. The 
anomaly of a professional group whose members have more, 
objective, verified information about the nature and require- 
ments of many other occupations than they do about their own 
should not, and will not, continue. 

Many of the kinds of research problems indicated in this 
brief survey are of the utmost complexity and present extreme 
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difficulties of accomplishment. Nevertheless, if standards are 
to be not only established and maintained, but improved, 
coordinated planning and execution of such research should be 
prominent among the means employed. 

If interested members of the American College Personnel 
Association, the National Vocational Guidance Association and 
the American Psychological Association, will promote and 
support effective action by these organizations to plan a joint 
research program for which necessary means of prosecution can 
then be sought, we may look forward with confidence to con- 
tinued improvement in the standards and status of the 
profession. 

Summary and Recommendations 

It is the thesis of this discussion that the research techniques 
characteristic of Personnel Psychology should, at the earliest 
possible date, play a dominant role in improving standards for 
counseling and guidance services. 

I. Job analysis techniques should be exploited to determine: 

a. What counseling and guidance now is, as well as what 
experts believe it should be 

b. What counselors must know, do, and be 

c. Leads for the development of criteria of effective 
performance 

■ 2 . Content and methodology of instruction for counseling and 
guidance personnel should be determined ultimately by re- 
search aimed at their validation against criteria of effective 
performance on the job. 

3. Selection of personnel to be trained in the field should em- 
ploy the best tools and procedures which current technology can 
provide and should be validated not only against success in 
training but on the job. 

4. While the complexities and difficulties are awesome, the 
logic of the situation demands that the techniques, basic to 
whatever scientific pretensions characterize counseling and 
guidance as a profession, be applied to the selection, training 
and evaluation of its own personnel and agencies. The pro- 
fessional organizations having interest in counseling and 
guidance should initiate plans for an integrated, cooperative 
research attack by all concerned. 
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SOCIO-ECONOMIC BACKGROUND OF WOMEN 
STUDENTS AT INDIANA UNIVERSITY 1 


KATE HEVNER MUELLER and JOHN H. MUELLER 
Indiana University 

With the recent recommendation of the President's Com- 
mission on Higher Education for a doubling of the numbers of 
college-age youth on the campus, new interest arises in the socio- 
economic sources of our present campus population. This study 
was undertaken to ascertain the sources of all of the women 
students at Indiana University and to relate the sources of all 
the women students of Indiana University to their curricular 
choices and to their membership in fraternal organizations 

A tabulation was made of. the personal data of the 2,517 
women students, enrolled during the second semester 1944-45, 
from the official records in the Registrar’s and the Counselling 
offices. These data included the following items - occupation of 
father, home address, school and major subjects in the Univer- 
sity, and membership in national women’s social fraternities. 
To insure greater accuracy and to reduce the number of in- 
complete entries, the personnel card was checked with the stu- 
dent at the time of registration by a special clerk. 

That university students are not uniformly distributed in all 
social classes is not a startling discovery, and Table 1 indicates 
the usual skew in the distribution or the degree of affinity be- 
tween the higher social classes and college attendance. The 
direct relation between social classes and higher education is 
continuous and unbroken. Although the professional classes, 
for example 1 , represent only 4.7 per cent of the state’s popula- 
tion, the student body shows 17,7 per cent affiliated with that 
class, yielding an index of representation of 377. On the other 
extreme, the unskilled group represents 20 per cent of the state’s 
population and only 3.4 per cent of the women student body, 

1 This study was made possible by a grant from the Administrative Research funds 
of Indiana University. 
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which is only about 17 per cent of its theoretical quota. The 
data from a similar study in 1940 show almost identical trends.* 
Because of certain population traits, this under-representa- 
tion of the lower classes is probably more exaggerated than 
these figures would indicate. If the proportion of each socio- 
economic class in the state’s population were weighted by the 
number of children characteristic of the class, the index of repre- 
sentation in the college population would be still further de- 
pressed for the lower classes where children are more numerous. 

TABLE 1 

Per cent Distribution oj Soeta-econamic Classes in Indiana University and w 
the Stale of Indiana and their Indices of Over- or Under -representation 
in the University 



Indian# Univer- 
sity 


Index of 
Represen- 
tation in 
the Uni- 


Num- 

I*cr 

Slate of 

verity! 

Socio-Economic Cla&a 

ber 

cent 

Indiana! 

1945 1940 

Professional. 

• • • • 359 

17.7 

4-7 

377 375 

Proprietors* Managers, Officials 

Wholesale & Retail Dealer*. 


11.7 

4-7 

462 

.... 191 

9-4 

5 -° 

188 250 

Salesmen, Clerks, and Kindred Workers . 

.. 3 'S 

1 J -7 

11. s 

123 210 

Farmers (Owners and Tenants). 

. 245 

ia.o 

IJ.g 

75 7 J 

Skilled Workers 

:::: 2 SS 

ia.8 

17.0 

75 61 

Semi-skilled Workers 

3-9 

W 9 

20 27 

Unskilled Workers (Inch farm laborers)... 

. £ 

3*4 

3-4 

20.0 

17 II 

Total* 

— 2031 

loo. 0 

100. 0 



* Excludes 486 out-of-state students. , 

f Adapted from: Alba M. Edwards, Comparative Occupation Statistics, U. S, sSyo- 
1040, s6th Census, United States Bureau of Census, 1943. . 

t The index is a measure of representation such that too would indicate n uniform 
distribution of social-economic classes for both the state and the University. There- 
fore an index of 377 shows that the professional class is over-represented by almost 
four times in the University population, ns contrasted with the expected proportion 
from the state population. 

Then, too, large state universities such as Indiana University 
attract a disporportionately larger number of students from 
these classes in comparison to the private colleges and univer- 
sities where tuition costs are much higher, and competition for 
admission more keen, On the other hand, this circumstance may 
be partially offset by the enrollments in teachers’ colleges of 
which there are several in the state of Indiana, where one might 
find a larger proportion from these classes. Nothing less than an 

! Mueller, JohnH. and Mueller, KateH., "Socio-Economic Background and Campus 
Success." Educational and Psychological Measuhment, 111 (1943)1 143 I S°- 
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adequate sampling of every type of college in the state, and a 
survey of the youth of the state who are attending out-of-state 
colleges would justify specific conclusions on these questions. 
There is no reason to doubt, however, the approximate validity 
of these findings as generally applicable to the total situation 
in regard to women students. For men students, who enjoy 
different outlooks on life and widely different personal habits 
and economic resourcefulness, the distribution of enrollment 
might show different characteristics. A comparable study for 
men is now in progress. 

Much of the social life of the midwestern campus is centered 
around the Greek letter fraternities and it is therefore important 
to follow the progress of the socio-economic groups through 
their fraternity affiliations, which will give a measure of their 
adjustment to campus life. The fifteen women’s fraternities 
at Indiana University in 1945 which have membership in the 
National Panhellenic Congress may be divided roughly into 
three groups on the basis of their age, size on this campus, and 
general prestige. Table a offers evidence to show that the hier- 
archy of prestige which the fraternities enjoy is in general 
supported in terms of the social-economic classes from which 
they draw their membership. Group I, comprising the five 
oldest organizations, draws more heavily from the three highest 
classes. Group III, comprising the five youngest and smallest 
groups, draws more frequently from the salesman, farmer, 
and skilled-worker classes More specifically, Group III draws 
twice as high a proportion from these four lowest groups, as 
Group I. 

On the basis of the 36 per cent of the total number of women 
students who held sorority memberships, the over or under- 
representation is given in Table 2 for each socio-economic class. 
It is obvious that the four lower classes are grossly under- 
represented, and this situation places a heavy burden of re- 
sponsibility on the University for providing and encouraging 
adequate and low-cost opportunity for social contacts and the 
development of social skills for these students. 

vVhen the indices for sorority membership are calculated for 
students from rural, small town, and metropolitan areas, the 
highest index is shown for middle-sized cities, 2,500 to 25,000 
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with an index of 130, and for cities of 25,000 to 100,000 with an 
index of 117. The largest cities of the state, 100,000 and over 
(Fort Wayne, Gary, Indianapolis, and South Bend) approxi- 
mate more closely the expected index (108). The largest cities, 
all out of state, and the farm and rural non-farm areas within 
the state, are all under-represented with indices of 64, 50, and 
88 respectively. Apparently the fraternal organizations are a 
phenomenon to a large extent of middle-sized cities. This may 
be inferred from the fact that, for example, 36 per cent of the 
total women student body is affiliated with sororities, but 45 
per cent of the women students from cities 2500-25,000 and 
40 per cent from cities 25,000-100,000 are so affiliated. Rural 


TABLE 2 


Per cent oj Each Socio-economic Clan in Specified Sorority Groups, in the 
Unorganized Group 


Socio-Economic CUm 

Per cent in Specified 
Sorority (5 rtupa 

Total i ir nr 

22 ia. ia 

Unor- 
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5* 

p 

62 
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Sororltv 
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Proprietors, Managers Officials . . . 

4« 
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19 

17 

3 

3 

t 

17 12 

11 io 
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Skilled Workers ... ..... 

Semi-skilled Workers . . 

■■■13 

20 

.. . 18 

6 

4 6 

7 io 
io 7 

«? 

80 

8a 

94 

88 

36 

*6 

17 

33 

Unknown 


3 

4 S 


* Let too cqunl the total per cent of women affiliated, which is 36 per cent. Since 
48 per cent of the professional group arc affiliated, their representation, over ex- 
pectancy, is 33 per cent. The index is therefore 133. 


students especially are at a distinct disadvantage in establish- 
ing the security in social relations which sorority membership 
accords to its members on the campus. 

Not only do the four lower classes send a smaller proportion 
of their children to the University, but according to Table 3, 
of those who do enter, a relatively smaller proportion remain 
to earn a degree. 3 The significant figure in this table is the high 
index of graduating seniors from the professional class in con- 
rast to that of other social-economic classes. This is confirmed 


’These calculations are only approximations, since they assume a constant ratio 
of enrollment throughout the four years preceding 1945 in regard to the socio-economic 
classes. That this assumption is fairly sound, is shown by the fact that there are only 
small changes in the proportion for each class in 1940 and in 1945. It would be ideal 
to follow a cohort of freshmen through their four college years, but until such data are 
available, these tentative conclusions may be acceptable. 
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also in the 1940 study where the index was 167. In the 1940 
study, it was also shown that the grades for the professional 
class were somewhat higher and the academic honors (member- 
ships in departmental Greek letter societies, etc.) noticeably 
higher. In explanation, it might be argued that the professional 
classes are better motivated, and find more pleasure in their 
academic achievement. It is also probable that the daughters of 
the professional classes show more willingness to delay mar- 
riage until after graduation than do the girls from other classes. 

TABLE 3 

Per Cent Distribution of Socio-Economic Groups of Women Students m 
Indiana University by Classes. and Index for Seniors tn Terms of 
Entering Freshmen , 1945 


Socio-Economic Class 
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10.6 

8 3 

9 OI 

9 81 

92 

Clerks . 

. 16 3 

17-5 

18 j 

16.6 

1 02 

Farmers .... 

13*0 

9 S 

8.4 

9 8 

75 

Skilled . . 

. 14.0 

11. 8 

is 5 

7 9 

56 

Semi-skilled . ... 

4.4 

2-9 

3 7 

3 3 

75 

Unskilled 

, . , . 29 

3 3 

1 -5 

1 9 

65 

Unknown . 

2.2 

a. 4 

3 5 

4-4 

Total 

loo 00 

100.00 

100.00 

TOO OO 



Financial difficulties also contribute to the losses in some of the 
lower classes. 

In view of the current shortage of teachers, it is of interest 
to note that in general it is the lower socio-economic classes 
which are sending more than their quota of recruits into the 
teaching profession (Table 4). It is unfortunately not possible 
to compare our data with the distribution of students in the 
Teachers Colleges of the state in the various economic classes. 
The generalization holds true, however, for those students who 
seek their training at the University, and there is no reason 
to believe that it may be otherwise in other institutions of 
learning in this state. 

Daughters of farmers, perhaps attracted by the contrast 
of city life and opportunities, are much over-represented in the 
Business School. This is confirmed by the similar over-repre- 
sentation of both rural and rural-non-farm (villages of less 
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than 1500) in the Business School, as indicated in Table 7. 
The only other significant feature in this table is the over- 
representation of the metropolitan centers in the Arts College, 
and their under-representation in the Business School. Women 
students from such centers, (all of them from outside the state 
of Indiana) apparently seek the liberal education rather than 
the vocational, 


table 4 

Indices of Representation oj Socio-Economic Groups in Specified Schools 
{Freshmen omitted) 


Judex of Choice 

Ann ft ml 

Sciences Education Business 

N-74S N-370 N-263 

Professional ill 8a 84 

Proprietors 104 84 110 

Wholesale-Retail Dealers 94 100 123 

Clerks 101 94 88 

Farmers 87 99 141 

Skilled Workers 99 122 108 

Semi-Skilled Workers 93 131 62 

Unskilled Workers. 93 109 83 


TABLE $ 

Geographical Distribution 0} Women Students by Classes, Senior and Freshman Index 


All Students Freshmen Senior 


ber cant bet* cent bar cent Seniors 

Indiana 2031 80.7 781 80.2 303 82.6 128 

Contiguous States 214 8,5 86 8.8 30 8,2 93 

Other States 257 10. 2 103 10.6 31 8.5 80 

Unknown 1) 0.6 4 0.4 3 0.7 


Total 2517 ioo.o 974 100.0 367 100.0 


Tables 5 and 6 indicate the sources by states, and sizes of 
home towns, of the women students at the University, About 
11 per cent of the women come from farms, another 16 per 
cent from towns of less than 2500 inhabitants, making about 
27 per cent of the women student body quite clearly in the non- 
urban group. Cities from 15,000 to 500,000 claim an additional 
44 per cent and a small group, about 4 per cent, come from 
metropolitan centers (necessarily outside the state of Indiana) 
of 500,000 or more population. In comparing the degree stu- 
dents, those who stay four years and earn the Bachelor’s degree, 
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with those entering the University, the under-represented 
groups are the farm students and the metropolitan students, 
and the over-represented are the small town, (under 2.5,000) 
group. 


TABLE 6 

Urhcin-Rural Distribution of Women Students by Classes; Per Cent in the 
State , and Index of Over- or Under-representation, Indices for Seniors 
in Terms of Entering Freshmen 



All Students 

Per cent of 






Indiana 

Rcpre- 



Number 

Per cent 

Population 

sentatioa 

Se niors 

Farm 

22.8 

II 2 

23 7 

47 

t >5 

Rural, Non-Farm. . . .. 

• . 328 

l6. I 

21.2 

76 

40 

Towns 2500-15,000 . 

572 

28 I 

1 6 2 

173 

97 

Towns 2,5000,-100,000 

. . 320 

ij.s 

17 9 

88 

105 

Cities. 100,000-500,000 . 

— 576 

28 4 

21.0 

135 

99 

Unknown ... 

• ■ 7 

O.4 




Total ... 

2031 

100.0 

100.0 




* Let 100 equal the per cent of Indiana population of specified geographical groups. 
Thus, the University Farm students, with only u.a per cent and the Indiana popula- 
tion, with 35 6 per cent are under-represented by about two-thirds The index: 31. 


TABLE 7 

Indices of Representation of Specified Groups in the Various Schools of the University 


Index of Cboice 


Geographical Groups 

Arts and 
Sciences 

Education 

Business 

Rural-Farm 

... 95 

99 

ns 

Rural-Non-F arm 

84 

III 

126 

Small Town 2500-25,000 

. . 104 

92 

IOI 

Midsized 25,000-100,000,. . . 

.108 

87 

96 

City 100,000-500,000 . r ... 

106 

107 

88 

Over 500,000 ...... . . . 

... 124 

98 

Ji 

Indiana. 

.... 98 

IOO 

10 5 

Contiguous States . . ... . 

101 

93 

99 

Other States 

”5 

96 

ss 

Sorority Groups, 

102 

81 

1 14 

Unorganized . . . 

. . . . 98 

no 

87 


As already inferred above, the figures in Table 6 are not 
necessarily representative of students from these areas in edu- 
cational institutions in general. There would be reason to believe 
that Purdue University, the Land-Grant College for the state 
of Indiana, attracts more students from the Rural and Rural- 
non-Farm areas, and that the farm girls attend Purdue unless- 
they plan for a business career, for which training would be 
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available only at Indiana University. Studies similar to the 
present one at all Tour state institutions might be expected to 
reveal over- and under-representation of various classes and 
areas in the various colleges. 

The various undergraduate schools of the University exert 
a different attraction upon the respective socio-economic 
classes. Broadly speaking, the higher social classes enroll in 
the College of Arts and Science, while the School of Education 
with its strong vocational emphasis exerts a greater attraction 
for the lower groups. 

At the time of registration, each woman student was asked 
to name her major subject, and approximately 80 per cent of 
them responded. Technically, the major subject is not declared 
until the end of the second year, and many first- and second- 
year students are very uncertain in regard to their final choice. 
The information gathered from these cards indicated, therefore, 
in perhaps 50 per cent of the cases, only the student’s present 
intention or tentative choice. 

It is apparent that there is some trend, although not com- 
pletely consistent, for the students affiliated with sororities 
to choose the more liberal education, in contrast to the more 
professional or vocational curricula. This is to be noted es- 
pecially in the choice of major subject where that has been 
noted on the registration cards. Approximately 34 per cent of 
all the women were undecided about their major subjects, 
but of those who did declare themselves, the index for the soror- 
ity students is high for Languages (141)- the Humanities (x 16), 
the unusually low for Nursing, Home Economics, and Educa- 
tion. In contradiction to this trend, however, the sorority 
students show a high index for both Business as a major sub- 
ject and for enrollment in the Business School, perhaps because 
proprietors, managers, wholesale and retail dealers are over- 
represented in the sororities. 

Indices calculated for the major subjects of the various socio- 
economic groups are not given in detail because theie are no 
striking differences nor general trends. The greatest deviations 
occur with the farmers, who show an index of 170 and 159 for 
Business and Nursing, respectively, and under-representation 
in all other subjects. In general the higher economic groups show 
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more decision and the lower groups more uncertainty in re- 
cording their preferences. 

The 97 major subjects printed on the registrar’s card and 
checked by the students have been grouped together as Physi- 
cal Sciences, Languages, Humanities, etc., and the index num- 
ber has been calculated for the socio-economic classes, the home 
state and home town groups and the sorority and unorganized 
groups. There are but few striking differences, other than the 
trends which are apparent in the index numbers for schools 
in Tables 4 and 7. The professional class is attracted strongly to 
the Sciences (117) and the Humanities (in). Farmers have their 
highest index numbers on business subjects (170) and Nursing 
(159), and are under-represented in every other subject All 
three of the laboring classes are over-represented in Teaching, 
(113, 138, 206), and all three are very much under-represented 
in Journalism (21, 60, 88). There are few differences between 
the in-state and out-of-state students, except that the non- 
state students are over-represented in English and Speech, 
and in Teaching, and under-represented in Business, Nursing, 
Fine Arts, and Music. Sorority groups are over-represented in 
Languages (168) and Business (128), and the unorganized in 
Nursing (122) and Home Economics (121) . The farm and rural- 
non-farm girls again show a strong preference for Business and 
Nursing, and the girls from the largest cities are over-repre- 
sented in Journalism, and the Sciences. 

More frequent and extensive studies of the sources of our 
students will be necessary before we may be able to trace the 
trends and movements in student population groups. Especially 
with the government program of financing higher education for 
the veterans of World War II, the study of the sources of these 
added students would contribute much needed information for 
theunderstandingof the effectiveness of our educational program 
as a democratic nation. 




A NOTE ON THE RELATIONSHIP OF THE KUDER 
PREFERENCE RECORD SCALES TO COLLEGE 
MARKS, SCHOLASTIC APTITUDE AND OTHER 
VARIABLES 


W. S. PHILLIPS 

AND 

R. T. OSBORNE 1 

As Strong 3 has pointed out, it has been difficult to secure good 
samples for use in differentiating occupational interest patterns 
among college students. In the case of the present study, data 
were available on rather large samples of both Business Ad- 
ministration and Arts and Sciences students of the University 
of Georgia, as secured at the University Guidance Center. 
Data on several thousand students had been coded and punched 
on Hollerith cards. This covered many test scores and other 
pertinent scholastic and personal data Although not col- 
lected in a planned experimental study, it appeared that much 
of the data had representative qualities. 

In the study now reported, all data relates to records secured 
at the Center during the scholastic year 1946-47. The several 
groups used in the present study were selected in the following 
manner : 

1. The Control Group is composed of approximately 240 
male University of Georgia students selected at random from 
those students who, at the time the study was undertaken, had 
not been excluded or placed on probation for scholastic 
deficiency. 

1 . The Probation-Exclusion Group is made up of those male 
students (N = 180) who were excluded or placed on probation 

1 Veterans Administration Branch Office § 5 , Chief Clinical Psychologist and 
Acting Director, University of Georgia Guidance Center, respectively. Published 
with the approval of the Chief Medical Director, Department of Medicine and Surgery, 
Veterans Administration, who assumes no responsibility for the opinions expressed and 
conclusions drawn by the authors. 

2 Strong, E. K., Jr. Vocational Interests of Men and Women. Stanford University: 
Stanford University Press, 1943, p. 47. 
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for scholastic deficiency during Fall Quarter 1946 and Winter 
Quarter 1947. 

3. These two major groups were studied in preliminary 
analysis from a number of approaches. The subgroups re- 
ported in this study are as follows: (a) students in the School of 
Business Administration; (b) students not in the School of 
Business Administration; (c) students earning scores above the 
2.5th percentile on the Ohio State Psychological Test, Form 21; 
and (d) students earning scores below the 25th percentile on the 
Ohio State Psychological Test. Norms used are national 
percentile norms except the American Council Psychological 
Examination , 1946 Edition, in which case University of 
Georgia Freshman norms were used. 

Results 

In Table i, the Control Group is compared with the Proba- 
tion-Exclusion Group. It is seen at once that the Probation- 
Exclusion Group is an inferior group on scholastic indices. In 
turn, the Control Group falls within normal limits as respects 
average scholastic test scores. The two groups differ sig- 
nificantly as respects scholastic ability, the mean percentiles 
of the Control Group on all such indices being higher than the 
mean percentiles of the Probation-Exclusion Group. The 
difference in means between the two groups on the Bell Adjust- 
ment Inventory is not statistically reliable. 

In Table a are presented correlation coefficients between 
Kuder Preference Record subtest scores, the Ohio State Psycho- 
logical Test, Form 2 / , and college marks (weighted grade 5 ) for 
students selected at random from the School of Business 
Administration. From the table it is seen that the only reliable 
correlation coefficient is between the Literary interest subtest 
of the Kuder Preference Record and scholastic aptitude as 
measured by the Ohio State Psychological Test. In all instances 
except one, these r’s compare favorably with the correlations 
reported in earlier studies. Yum 4 found the highest correla- 
tion (+ .34) between the Literary interest score and college 

5 Weighted grjtde is determined by multiplying the earned course grade by the 
number of hours the course meets per week. 

(Yum, K. S "Student Preference in Divisional Studies and Their Preferential 
Activities." The Journal of Psychology, XIII (1941), 193-300. 
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marks The present data yield a correlation coefficient of 
+ .38 between Literary interest scores and the Ohio State 
Psychological 'Pest, Total Score 

TABLE 1 


Comparison oj Control and Probation Groups m Terms of Mean Percentiles on Tests of 
Intelligence, Scholastic Aptitude , and General Educational Development 


Teat 

Control Group 

Probation Group 


N 

Mean %ile 

N 

Mean %ile 

Diff. 

OSPT Total Form 11 . . 

445 

S3 97 

275 

32 84 

21 13* 

Otis Q S. Gamma . . 

344 

72.41 

238 

56 00 

16.41 

GED I Exp, 

2.40 

34 9 2 

190 

19 10 

15 82 

GED II Soc. Sci 

. 286 

61 81 

210 

40 09 

21 72 

GED III Nat Sci. . 

35 ° 

68.74 

at8 

46. 17 

22 57 

GED IV Lit Mat 

316 

41 67 

217 

26 84 

14.83 

Iowa Content Eng 

. l62 

54-33 

IS6 

33 34 

20 qq 

Iowa Content Math. 

156 

72 74 

146 

53 92 

18 82 

Iowa Content Sci 

160 

57 92 

I48 

38 34 

19.58 

Iowa Content Soc. Set , 

157 

58.58 

I46 

38 76 

19 82 

Iowa Content Total 

152 

62 33 

144 

42 01 

20 32 

ACE Total . ... . . 

40 

S7 75 


37 92 

19 83 

Bell Adj Total.. . .. 

. . 221 

57 °8 

178 

58.17 

I.O9 


* All differences significant at 1% level of confidence except Bell Adjustment 
Inventory 


TABLE 2 

Correlation Coefficients Between Kuder Preference Record Scales, Ohio State Psychological 
Test and College Marks for Control Group ( N — 152) 


Scale 

Ohio St Pay Test 
Form 21 

Weighted Grade 
(College Marks) 

Mechanical 

-.18* 

— 10 

Computation 

- 13 

+ ■03 

Scientific 

- 04 

+.05 

Persuasive , ..... 

+ 03 

— .06 

Artistic 

— . 10 

— .02 

Literary 

+ 39 

+.08 

Musical . 

+ • 03 

+ .04 

Social Service 

. - 24 

— 1 1 

Clerical. . . ... 

- 04 

+ °5 


* All P.E.’s approximately — 05 


Table 3. Kuder Preference Record responses for the Control 
Group are divided into four subgroups as follows: (a) Business 
Administration students; (b) non-Business Administration 
students; (c) students who earned a percentile rank below 
Qi on Ohio State Psychological Pest-, (d) students who earned a 
percentile rank above Qi on Ohio State Psychological Pest. 

On all Kuder subtest scores except one (Musical), the Busi- 
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ness Administration students differed significantly from the 
non-Business Administration students. On five subtests (Me- 
chanical, Computational, Scientific, Persuasive, and Clerical) 
the differences are significant at the I per cent level, while three 
differences (Artistic, Literary, and Social Service) are sig- 
nificant at the 5 per cent level. On Mechanical, Scientific, 
Artistic, Literary and Social Service interests, the non-Business 
Administration students are significantly higher than those in 
the School of Business Administration. On Computational, 
Persuasive and Clerical interests, the Business Administration 
students are significantly higher than the non-Business Ad- 
ministration students. 


TABLE 3 

Comparison oj Business Administration Studies of the Control Group in Terms of Mean 
Percentile on Kuder Preference Recot‘d Scales 


K PR. Scale 

Dus. 

N - 84 

Noo‘IJu*. 
N - 150 

Dm. 

Below Qi 
OSPT 

N - 40 

Above Qi 
OSPT 

N - 198 

Dm. 

Mechanical 

... 30.01 

39-17 

10.15* 

47-50 

32. SI 

14.99* 

Computation 

... 68.33 

+2.92 

25.41* 

54 - r 7 

SO -75 

3.42 

Scientific 

• -■ 17.43 

44 - 2.1 

16.82* 

42.92 

37-76 

S-r6 

Persuasive 

.. . 81.91 

6CK44 

21 - 47 * 

62 . 71 

69.41 

6.70 

Artistic 

.... 37.92 

43.59 

7 - 67 1 

50. 00 

4 1 - 5 ) 

8.49 

Literary 

Mu sic ill . 

• 53-12 

.... 37-38 

61.7a 

51-39 

8.6of 

35-09 

48.75 

63.66 

54-67 

30.57* 

5-92 

Social Service . 

.... 60.56 

69.41 

“■Bst 

74.99 

64.50 

I 0 . 49 t 

Clerical 

7 J .83 

45 .25 

26.58* 

50.83 

54-92 

4.09 


* Significant at x% level of confidence, 
t Significant at 5% level of confidence. 


Further analysis of the Kuder Preference Record scores for the 
Control Group shows that there is little difference in the Kuder 
subtest scores when this group is divided into those earning 
above Qi on the Ohio State Psychological 'Pest and those earning 
below the Qi on the Ohio State Psychological Pest. The high 
scholastic aptitude group scored significantly higher on the 
Literary subtfest of the Kuder Preference Record. The low apti- 
tude group was higher on Mechanical and Social Service 
interests. 

In Table 4, probation and excluded students are compared by 
college and level of scholastic aptitude. This group of Business 
Administration students who were on probation scored sig- 
nificantly higher than the non-Business Administration pro- 
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bation students on Computation, Persuasive, and Clerical 
subtests. The non-Business Administration students were 
higher on Scientific interests. Other differences in interest 
scores are not significant below the 5 per cent level. It will be 
recalled that the Control Group of Business Administration 
students scored higher than non-Business Administration stu- 
dents on Computation, Persuasive, and Clerical subtests, 
while the Control Group of non-Business Administration 
students scored higher on Mechanical, Scientific, Artistic, and 
Literary subtests. 

It is seen from Table 4 that probation and excluded students 
of low measured scholastic aptitude (below Qi on Ohio State 

TABLE 4 

Comparison of Business Administration Students vs Non-Business Administration 
Students of the Probation Group m Terms of Mean Percentile on Kuder 
Preference Record Scales 


KPR Scale 

Bus. 

N *= 78 

Non-Bus 
N — 76 

Diff 

Below Qi 
OSPT 

N = 90 

Above Qi 
OSPT 

N * 92 

Diff. 

Mechanical . 

34 09 

34 17 

.08 

36.34 

37.26 

92 

Computation , 

• • . . 65 33 

45 84 

I 9 49 * 

59 72 

52.74 

6.98 

Scientific . . . 

3 ° Si 

42 59 

12.08* 

34-76 

37 09 

2.33 

Persuasive. 

76 16 

6l . 14 

15.02* 

70.66 

68.99 

1 67 

Artistic 

■ 39-84 

46-34 

6.50 

44 00 

42 26 

1 74 

Literary. 

56 71 

56 32 

•39 

43.42 

6r 79 

18 37* 

Musical 

54-68 

5 i -49 

3 19 

55-74 

50.48 

5.26 

Social Service 

63 58 

68.83 

5-25 

67 58 

63.33 

4 25 

Clerical 

70.41 

49.85 

20.56* 

64.83 

55 14 

9 . 6 9 t 


* Significant at i% level of confidence, 
f Significant at 5% level of confidence. 

Psychological Test) differ from similar students of higher apti- 
tude (above Qi on Ohio State Psychological Test) on only two 
subtests of the Kuder Preference Record. Those of higher 
aptitude are significantly higher in Literary interests, while 
those of lower aptitude are slightly higher m Clerical interests, 
Other differences are not significant below the 5 per cent level. 

In Table 5, students on scholastic probation are compared 
with the Control Group by college and Kuder Preference 
Record subtest scores. There are no statistically reliable 
differences in means in Kuder subtest scores for this group, 
i.e., Kuder Preference Record scores for students on scholastic 
probation do not differ significantly from those not on 
probation. 
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Probation students who are in the School of Business Ad- 
ministration do not differ in Kuder Preference Record scores 
from Control Group students who are in the same school. It is 
also seen from this table that Kuder Preference Record scores 
of probation students selected at random from the University 
population do not differ significantly from Kuder scores of 
students selected at random from the School of Business 
Administration. Although no difference in Table 5 is sig- 
nificant below the 5 percent level, the direction of the differences 
seems to suggest that students in the School of Business 
Administration, who are not on scholastic probation, score 
higher on those Kuder subtests which are typical of business 

TABLE s 

Companion oj Control and Probation Croups in Terms of Mean Percentile on Kuder 
Preference Record Scales 

Business Administration Non-U u.tncu Administration 


Kru St»ic 

N - 78 
Probation 

N ™ 84 
Control 

nur. 

N - 76 
Probation 

N « 150 
Control 

DHL 

Mechanical 

34-09 

29.01 

5.08 

34- 17 

39-17 

5 00 

Computation 

65-33 

68.33 

3.00 

4 S .84 

41-91 

7.02 

Scientific 

3 °- 5 i 

17.43 

3.08 

41.59 

44-25 

1 66 

Persuasive 

76.16 

81.91 

5-75 

61.14 

60.44 

.70 

Artistic 

39-84 

37-91 

1.92 

46.34 

45 59 

•75 

Literary 

Musical 

56. 71 

S 3 .li 

3-59 

S6.31 

6i:,72 

5-40 

54 . 68 

57.38 

a. 70 

SI - 49 

51-39 

. 10 

Social Service ... 

6358 

60 .56 

3.01 

68. 83 

69.41 

.58 

Clerical 

70 - 4 1 

71.83 

1.4a 

49 -8S 

45-15 

4 60 


school students than do probation students. If this direction 
of differences were reliable, it would suggest a trend of inter- 
pretative value. The non-Business Administration non-pro- 
bation students scored higher on the subtests which are typical 
of the group selected at random. 

Summary 

Test results and scholastic records of over 400 University of 
Georgia male students were analyzed by level of scholastic 
aptitude, college marks, occupational preference and academic 
adjustment. Results of this preliminary study seem to justify 
the following conclusions: 

1. Students in the School of Business Administration seem to 
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have characteristic occupational interest profiles on the Kuder 
Preference Record Business Administration students, whether 
selected at random from the University student body or se- 
lected from the list of probation and excluded students, scored 
significantly higher on the Persuasive, Computational, and 
Clerical scales of the Kuder Preference Record than do non- 
Business Administration students. 

i. The present data show no significant relationship between 
the several Kuder Preference Record scales and weighted grade, 
i.e. , for the subjects of this study, college marks could not be 
accurately predicted from scores on the Kuder Preference 
Record. 

3. A slight positive relationship was found between scores on 
the Literary scale of the Kuder Preference Record and scholastic 
aptitude, while Social Service, Mechanical and Computational 
scores seem to show low but negative relationship to scholastic 
aptitude. 

4. Kuder Preference Record scores for students on scholastic 
probation do not differ significantly from scores made by stu- 
dents not on probation. Numerically, the mean percentiles of 
non-probation students are higher than those of probation 
students in Business Administration on those sub-tests that are 
typically high for students of this school. That the difference 
is not statistically significant makes additional comment 
largely speculative. There is, however, sufficient intimation 
that “highness” on these typically high sub-scores may relate 
to factors underlying successful work in this school so as to 
warrant more extensive study. 




MOTIVATION AS A PREDICTOR OF COLLEGE 
SUCCESS 1 


FRANCIS J. DI VESTA, ASAHEL D WOODRUFF and JOHN P. HERT EL 

Cornell University 

• The present study has two purposes One of them is to check 
on the stability of formulas for predicting college success. It is 
suspected that a formula developed on data acquired in any one 
academic year may not yield the same results with data 
gathered in another year. The second purpose is to investigate 
the contribution which motivational and adjustmental factors 
may make to college success. The New York State College of 
Agriculture has consistently conducted exit interviews with 
students who leave the College before completing their work. 
As a result of these interviews the conviction has developed that 
circumstances other than academic ability play a significant 
role in success or failure. The second phase of this study received 
its content largely from the records of such interviews. 

In a previous study (i) the average of Regents’ Grades 2 was 
found to be the best single measure for predicting college suc- 
cess The correlation was 53 between the Regents Average and 
the first-term average of students in the College of Agriculture. 
The best single test among those used for prediction was found 
to be the Ohio State Psychological 'Pest. The correlation between 
this test and the first- term average was .45. A multiple correla- 
tion between a team of four weighted scores ( Cooperative Science 
Pest, Cornell Mathematics Pest, Ohio State Psychological Pest and 
Regents Average) and the first-term average was .57 for all 
students and .64 for those enrolled in the general curriculum of 
the College of Agriculture. 

At the time the study was completed certain suggestions for 

1 The study was conducted by the University Testing Service at Cornell University 
in cooperation with the counselors in the College of Agriculture 

s Scores derived from New York State Regents Examinations constructed by the New 
York State Education Department and given at the completion of specific high-school 
courses. The average referred to is a non-weighted average of scores obtained on ail 
such tests taken by the student. It is known thoughout the state as the Regents Average 
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further study were made. These were (i) the inclusion of a 
measure of aptitude for college science which was independent 
of intellectual capacity insofar as possible, and (a) the inclusion 
of a measure of motivation in the battery of tests used for 
prediction. 

With reference to the first suggestion, the University Testing 
Service included a revised version of the /pjp Johnson Science 
Application Test in the freshman testing pogram. With refer- 
ence to the second suggestion an Orientation Inventory was de- 
vised and given to all freshmen during the first month of college. 
A copy of the Inventory appears in Table 4. 

Present Findings 

The results found in the present study show similarities to 
findings in the previous study as well as certain new findings. 
A list of correlations is presented in Table 1. 

As in previous years the Regents Average continues to be the 
best single measure for predicting success in college. The cor- 
relation was .54 between the Regents Average and the first- 
term average compared to the .53 found previously. The Ohio 
State Psychological Test was again the best single test for pre- 
diction purposes in the battery used. Its correlation with the 
first-term average in the present study is .36 compared to ,45 
in the previous study. This does not represent a significant drop. 
The difference between .45 and .36 is, via Fisher’s Z transforma- 
tion, only once its standard error. The distribution of scores in 
1947 and 1948 for each of the tests is very similar. This is shown 
in the table of mean scores and standard deviations, Table 1, 

The Revised Johnson Science Application Test proved to have 
predictive qualities very similar to the Cooperative Science Test. 

One of the most promising findings in the present study ap- 
pears to be the usefulness, for the prediction of the first-term 
average, of measures of motivational influences and certain ob- 
stacles to student achievement. The choices for each question 
on the Orientation Inventory had been graded from 1 to 5, one 
indicating that the factor would not hinder the individual’s 
achievement and 5 indicating that the factor would hinder the 
achievement considerably. The items on the Orientation Inven- 
tory were scored by totaling the choices checked. The choices 



TABLE 



1947 

N, 324 

1948 

N, ISO 


1947 

N. 324 

1948 

N. 150 

S' 1 

C,2 

C »3 

0,4 

C, 5 

0,6 

0,7 

C, 8 

0,9 

C, 10 

•S 3 

•45 

3 * 

— •OS 

■ 54 
•36 

2.7 

,08 

27 

— 22 

— 3 * 

' 5 l 

76 

•58 

2.5 
a ,3 

2. 1 

2.8 

2.6 

3 ,7 

5 .1 

5,3 

5.6 

5.7 

1 5a | 1 I I 1 1 II 

.40 

6l 

41 

29 

59 

— 07 

- 15 

.41 

71 

08 
— . 10 


C — Criterion 

1 — -Regents Average 

2 — Ohio State Psychological Examination. 

3 — Cooperative Natural Science Test. 

4 — Farm Experience Credits 

5 — Revised Johnson Science Application Test 

6 — Total Orientation Score. 

7 — -Part Score on Orientation Inventory 

8 — Freshman English Grade, Autumn Term 

9— Freshman Chemistry Grade, Autumn Term. 
to — Mid-term Freshman Average, Autumn Term 


Correlations Between 


First term college average and 
Regents Average 
Ohio State Psychological Exam 
Cooperative Natural Science Test 
Farm Experience 

Revised Johnson Science Test . . . 
Total Orientation Score 
Part Score on Orientation Inventory , . 
Freshman English Grade . . . 

Freshman Chemistry Grade 

Freshman Mid-term Average, Autumn 
Ohio State Psychological Exam and 
Revised Johnson Science Test 
Cooperative Natural Science Test, 
Regents Average 
Freshman English Grade. , 

Freshman Chemistry Grade 
Total Orientation Score 
Part Score on Orientation Inventory 
Revised Johnson Science Test and 
Regents Average 

Cooperative Natural Science Test , . 

Total Orientation Score 

Part Score on Orientation Inventory 


S 3 

54 

45 

36 

3 ^ 


05 

.08 

— 

.27 

■ — 

— 22 

' 

--32 

•57 

— 

76 

-58 

— 

.40 

47 

61 

• 5 i 

4 l 

— 

29 

— 

59 

— 

- 07 

— 

- 15 

— 

41 

— 

71 

— 

08 

— 

— 10 


TABLE 2 


Means and Standard Demotions of Entrance Scores in 1947 and 1948 



1948 Scores 

1947 Scores 

Test 

M 

ST 

M 

ST 

Ohio State Psychological 

, 81 82 

24 02 

83-19 

23.65 

Regents Average . 

83.50 

4 78 

83 31 

5 19 

Rev. Johnson Science Test , . . 

26 97 

6.21 

— 

— 

Coop. Science Test, 

•• • 58. 33 

12.49 

59-19 

13-43 


34 i 
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thus totaled provided scores which correlated — .aa with the 
first-term average. The minus correlation is a function of the 
scoring method. The significant fact is that the same score cor- 
related — .07 with the Ohio State Psychological Test. The total 
score from the Orientation Inventory and the Revised 'Johnson 
Science Application Test correlated +.08. When used as a team, 
the weighted scores of the Ohio State Psychological Test and the 

TABLE 3 

Multiple Correlations Between Fartous ComiinatwHi oj IFeiphted Scores and the Criterion 


Scores Uftftd r 


i.a 

.41 

' i 3 


1,2, 4. 5, 

.60 

■7.5. 

.61 

I.3.S 

,62 

1,3.4, J 

.64 


I — Ohio Scare Psychological Test 
1 — Total Orientation Score 

3 — Part Orientation Score (Items 1, 4, 6, 5, It, 14, 17) 

4 — Revised Johnson Science Application Test 

5 — Regents Average 


Testa ot Scores Used 


Ohio State Psychological Test + Total Orientation Score 41 

Ohio State Psychological Test 4 - Part Orientation Score _ . . . ....... .43 

Ohio State Psychological Test + Revised Johnson Science Application Test . . . .46 

Ohio State Psychological Test + Regents Average + Revised Johnson Science 

Application Test -f- Total Orien tation Score 60 

Regents Average 4 - Part Orientation Score 61 

Regents Average + Ohio State Psychological Test + Pnrt Orientation Score 6a 

Regents Average -+• Ohio State Psychological Test + Revised Johnson Science 
Application Test + Part Orientation Score 64 


Orientation Inventory correlated .41 with the first-term average. 
By adding the Revised Johnson Science Application Test to the 
team, the correlation is raised to .60. The Regents Average still 
correlated more highly with the criterion than any other single 
variable which can be obtained prior to the availability of mid- 
term marks, and the Orientation Inventory score adds more to 
that correlation than any other variable included in the study. 

A second score was derived from the Orientation Inventory 
after the following manner: A regression equation was made 


Multiple 
Correlation 
of Team With 
Criterion 
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between the first- term average and the Regents Average. First- 
term averages were then predicted on the basis of the regression 
formula. If the actual first-term average was greater or less than 
the predicted first-term average by five or more points the 
Orientation Inventory for the particular individual was sorted 
into a corresponding group, i.e., one group was composed of 
those individuals making more than five points above the pre- 
dicted score and another group was composed of those indi- 
viduals making more than five points lower than the predicted 
score. The responses made on the Orientation Inventory by these 
two groups were then analyzed, as shown in Table 4. 

The association between responses made on any particular 
item and the group the individual is in on the basis of this selec- 
tion, is indicated by chi square. The probability indicates that 
a sample given a chi square as high or higher than the obtained 
chi square could be drawn by chance from a universe in which 
the true value of chi square is zero. So as not to violate the 
requirement of not-too-small expected frequencies, adjacent 
frequencies have been combined in order to avoid expected 
frequencies under five (3) The responses to the test items and 
the chi-squares with probabilities are reproduced in Table 4 to 
illustrate certain of the techniques and basic data used in this 
study. It is to be understood that the value of these data is 
limited with respect to the size of the population studied. On 
the other hand, the groups do represent all of the available 
cases meeting the requirements posited for representation in 
that group. 

Responses to items 2, 9, 13, 14, and 17 were found to be sig- 
nificantly different between the two groups. Items 3, 4, 6, 8, 11, 
although not revealing significant differentiation between the 
two groups, did indicate trends toward significance. Following 
this analysis, all Orientation Inventory forms were scored again 
by totaling the responses which each individual made to items 
3, 4, 6, 9, 11, 14 and 17. Item 2 was omitted because the choices 
here were set up in the opposite direction from the choices in 
the other items. This would have increased the difficulty in 
scoring by the machine method. The correlation between the 
resulting score (named the part score hereafter in the study) 
and the first-term average was —.32. When the part score and 



TABLE 4 

The Orientation Inventory rntlh Number of Response* Male by Students Having Actual 
First- Term ,'lra ages Greater Than Five Points Above at- Below Grades Piedicted 
Fiom Regents Am ages 


Question 


Number of Re- 

spon«9 Made by Degree 

Group 1* Group 2f * 1 Freedom 
24 o 28 


r. I feel that my present state af health is 

1, Much better than most people I know. o 

2. Better than most people I know ft 

j. About the same as most people 1 know, 17 
4 Poorer than most people 1 know, t 

j. Much poorer than most people l know, o 


2. The average number of hours I spend on 
work for board, room or cash each week is ■ 

1. None 13 

2 1-9 i 

3. lo-t8 6 

4 19-17 3 

5 Over 27 1 


3, Choose the statement which best describes 


your vocational plans. I have: 

r. A definite specific vocation planned. 10 

2. A definite broad field in mind. to 

3. Two or three areas from which 1 will 

choose a definite vocation. 3 

4. Two or three areas in mind but I am con- 
tinually changing my mind about them. t 

5. No vocational plans at present. o 


4. The average number of hours t spend in 
fraternity activity each week is: 

1 . None 20 

2. 1-9 „ 3 

3. 10-18 1 

4. 19-17 o 

5. Over 18 o 


5. Choose the statement which best describes 
your study habits with telation to other ac- 
tivity: 

t. Nothing interferes with my study. 2 

2. I occasionally forego necessary study for 

unrelated activity. 19 

3. Other activities interfere with my studies 

about one-half of the time. 2 

4. Other activities interfere with my studies 

much of the time. o 

; lam unable to keep other activities from 
interfering with my study. 1 


6 . The average number of hours I spend on 
sports each week is: 

I. None 


2. 1-9 

3. 10-18 

4. 19-17 
j. over 28 


ri 

10 

3 

o 

o 


0 
6 

20 

t 

1 

. 12 


14 

ro 

4 
o 

0 

9,70 

8 

8 

6 

5 

1 

4.20 

‘5 

9 

4 

o 

o 

5.09 


2 

23 

2 

1 

o 

.22 


7 

<5 

4 

2 

o 


2.48 


• 75 


2 .01 


2 i S 


1 .08 


1 .65 


1 .15 
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TABLE 4 — Continued 


Number of Re- 
sponses Made by 

Question 

Group 1* Group 2 1 
N — 24 N - 28 


x 2 i 


Degree 

of PH 
Freedom 


7 So far this term I have been ill and have 


missed classes 

1 Not at all ip 

1 Less than a week 2 

3 About one week 1 

4. Between one and two weeks 1 

5. Two weeks or more 1 


8. The average number of hours I spend on ex- 
tracurricular activities other than work, sports 
and fraternity each week is. 


1 None $ 

2 1 -9 1 6 

3 10-18 3 

4. 19-27 o 


5 Over 28 


9. Choose the statement which best describes 
how you feel about your note taking. 

1 Exceptionally neat and efficient — no re- 
organization necessary. o 

a Neat and efficient — a little reorganiza- 
tion is sometimes necessary 13 

j Some reorganization always necessary 10 

4. Considerable reorganization is always 

necessary 1 

5. Impossible to get my notes well organ- 
ized o 

10. So far this term I have gone home 

1 Not at all 7 

2, Once 9 

3 Twice _ 3 

4 More than two times 2 

5, Every week or Jive at home 3 


II. Choose the statement which best tells how 
you feel about the curriculum suggested by 
your faculty advisor. 

1 I would not exchange my course of study 


for any other 8 

2. I am not eager to change my course of 
study but I would if it were more practical. 14 

3 I would like to change my course of study 

for another somewhat similar to it. 2 

4 I would change my course of study to al- 

most any other course of study which was 
more practical. o 

5 I would like to change my course of study 

as soon as possible o 

12. The average number of hours I sleep per 
night is* 

1. 9 hours or more o 

2. 8 to 9 hours. 5 

3 7 to 8 hours 16 

4 6 to 7 hours 3 

5 Less than 6 hours o 


22 

5 

1 

o 

o 


II 

14 

3 

o 

o 


o 

5 

18 

3 

2 


II 

9 

1 

6 

1 


4 
16 

5 

1 

2 


o 

8 

37 

3 

o 


0.00 1 


2.09 1 


7.58 I 


•57 2 


3-17 1 


.41 1 


■15 


<-01 


•75 


.08 


50 
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TABLE 4— Continued 


Number of Re- 
apantes Made by 


Group 1* Group 2 \ 
N - 24 N - 2ft 


Degree 

ot 

Freedom 


PH 


II. 1 review my lecture notes the same day 
they arc taken: 

I, Always 
a. Almost always 
i. Occasionally 

4 . Rarely 

5. Never 


0 
7 
9 
6 

1 


14. Check the »«tatcment which best describes 
how > nu led about your present courses: 

1. All of my courses arc necessary for my 

particular plans or purpose* in coming to col- 
lege. to 

2. About three quarters of the courses I am 

taking seem necessary. 13 

3 About one-half* the courses that I am cak- 

1 mg seem necessary. I 

4, About three-quarters of the courses I am 

taking seem unnecessary for the purposes I 
had in coming to college. o 

5. None of my courses appear to be neces- 
sary for my purposes. o 


15. Choose the statement which best describes 
how you organize your time. 

1 . 1 am usually able to do 11 little more than 

is required of me in my courses. 1 

2. I am never behind with my regular 

assignments in my courses. 13 

3. I have all I can do to keep up with the re- 
quired amount of work. 8 

4. I frequently do not have time to do the 

minimum amount of work required in my 
course*. 1 

S* I never seem to have time to do the mini- 
mum amount of work required in my 
courses. 1 


16. The average number of hours I spend on 
study each week is approximately: 

1. Over 36 1 

a. 26-35 10 

3- 16-25 11 

4. 6-ic a 

5. Under 5 o 


17. Before coming to college I had been away 


from home: 

1. For many long periods of time. 5 

2. For a few long periods of time. 10 

3. Frequently but not for long periods. 2 

4. Rarely for long periods, 7 

5. Never o 


1 

2 



2 


8.79 2 <.02 


o 

7 

17 

4 

o 

30.31 2 < iOI 


2 

16 

8 

2 


O 

.24 I .60 


I 



4 

o 


1.61 r .10 


3 

4 
10 

8 

3 

10.15 2 <*01 


* Group 1 is composed of those students whose actual average grades are more than 
5 points above the average grades predicted on the basis of the Regents Average. 

t Group a is composed of those students whose actual grades are more than 5 points 
below the grades predicted on the basis of the regents average. 

t Chi square, a measure comparing observed and theoretical (as estimated from 
the sample) freauencies, 

HThe probability that with a given number of degrees of freedom the chi-square 
value obtained in the comparison of the distribution of the sample with the theoretical 
series dictate that the sample belongs to or has arisen out of such series. 
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the Ohio State Psychological P est are. used as a weighted team, 
the correlation with the first-term average is .43, compared to 
.41 when the total score of the Orientation Inventory is used 
The multiple correlation using the team composed of the part 
score from the Orientation Inventory , the Regents Average, the 
Ohio State Psychological Pest and the Revised' Johnson Science 
Application Pest against the first-term average is .64. 

An analysis of the items indicates that motivational influ- 
ences are important factors in scholastic success Items 11 and 
14 showed wide differences in responses made by the two groups. 
Roth of these items refer to the individual’s satisfaction with his 
present course of study. Items 4 and 6 deal with time spent in 
a fraternity or in sports. Items 9 and 13 deal with study habits 
and note-taking abilities. Item 17 deals with the adjustment of 
the individual. Item 1 might be useful in the part score by re- 
versing the position of the choices. This item when scrutinized 
shows that the individual who works for his college expenses is 
probably among the most highly motivated of the individuals 
attending college. “Time spent” in this item is easily differenti- 
ated from “time spent” on fraternity activities (item 4) and on 
sports (item 6). 

Summary 

The present Orientation Inventory and the results obtained 
from its use are still inadequate when compared to its poten- 
tialities. At present its usefulness is primarily limited to indi- 
cating areas which are important for prediction and secondarily 
for use in prediction formulas. The findings indicate that an 
extension in the length of the test with items centered about the 
areas of motivation , adjustment and study habits, in that order of 
importance, should produce an instrument highly useful in the 
prediction of scholastic success. Certain observations are im- 
portant for the development of such an instrument. Not only 
should the items be relatively objective in the sense that the 
individual can easily estimate the actual time factors asked for, 
but the items should be indicative of the area being measured 
and still should be somewhat disguised as to their real pupose. 
The ultimate aim in constructing such tests is to discover items 
which may be used before the individual enters college. 
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Certain items in the present Orientation Inventory may be in- 
adequate because the responses established for the individual 
taking the test are too broad. For example, one item (item 8) 
provides categories of a 9-point range. This item might be more 
discriminating if put on a 3- or 6-point range. 

The specific items used successfully in this study represent 
broad areas of psychological importance. They have proved to 
be reasonably successful in a College of Agriculture where the 
required portion of the program is not always what the indi- 
vidual expected it to be. The students were selected so as to 
eliminate this factor insofar as possible by including only the 
men enrolled in the college. The success of the items in the 
Orientation Inventory, therefore, may or may not be unique to 
one college. However, they do provide indications of areas in 
which further study may profitably be made and in which con- 
siderable research is necessary. Studies such as that of May (2) 
showing the relationship of study hours per week to academic 
success have been, for some reason, neglected as leads for pre- 
diction studies, Although more restricted in scope than the 
present study they, too, have indicated the importance of 
motivational influences even though not ostensibly so. 
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EDITOR’S FOREWORD 

The annual meeting of the American College Personnel Association 
was held in Chicago from April 18-ai, 1949. The Proceedings in- 
clude all of the papers presented, except for several to be published 
in other journals as indicated and several instances in which formal 
papers were not read. Because there were thirty-seven papers this 
year, and because of printing limitations, the remarks of the discus- 
sants are not being included. 

As a constituent member of the Council of Guidance and Personnel 
Associations, our organization participated in the “Council Day” 
program. In accordance with the theme of the convention, “Achieving 
Common Goals in Guidance,” Chairman Thelma Mills of the Study 
Commission of the Council of Guidance and Personnel Associations 
reported on their work for the past year. Copies of this report are 
available from Miss Mills, University of Missouri, Columbia, 
Missouri. Other “Council Day” speakers and the titles of their 
addresses were: 

William C. Johnstone, Jr., Director, Office of Educational Ex- 
change, Department of State: Achieving Understanding Through 
International Educational Exchanges. 

Claude V Courter, Superintendent of Schools, Cincinnati Public 
Schools: Significant Aspects oj Personnel Work in City School 
Systems. 

Charles J. Turck, President, Macalester College: Significant 
Aspects oj Personnel Work in a Small Liberal Arts College. 

William S. Carlson, President, University of Delaware: Signifi- 
cant Aspects of Personnel Work in a University, 

These papers are not included in the Proceedings. 

Next year’s conference will be at Atlantic City from March 27-30, 
1950 With a membership now of over seven hundred names, ACPA 
is looking forward to another successful year of endeavor and 
progress in the college student personnel field 

C. H. Ruedisili 
University of Wisconsin 
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Presidential Address 


“THE FAULT, DEAR BRUTUS—” 

C. GILBERT WRENN 

Professor of Educational Psychology, University of Minnesota 

Last year at the occasion of the annual banquet I discussed 
certain critical points in the organization and functioning of 
student personnel work, This year I should like to speak about 
the personnel workers themselves. This means shifting atten- 
tion from the job to the person performing the job, and that 
includes all of us. Any of you who have been sufficiently cu- 
rious about, the title of this address to recall the balance of the 
quotation will have realized by this time that the topic was 
addressed to us as people rather than to the job to be done. 
When Shakespeare had Cassius say “the fault, dear Brutus, is 
not in our stars but in ourselves, that we are underlings” he 
was speaking of the larger significance of human existence it- 
self, but it seemed to me that his thought might be applied to 
this day and age and to us. We are a comparatively young pro- 
fession and it is common for the young occasionally to raise 
questions about themselves and their purposes in life. Our youth 
as a profession is a strength in that it enables us to be vigorous 
and aggressive and to make mistakes without being too much 
disturbed by them. It is at the same time a weakness, for we are 
all too frequently as lacking in consistency and self-assurance 
as is the adolescent in general. 

A logical interpretation of this quotation would lead to the 
conclusion that I believe that personnel workers are in the 
position of “underlings.” There are times, of course, when each 
of us is quite sure that he is an underling, subordinate to far too 
many people, but it is not my belief that the profession is now 
in a position subordinate to that of other educational specialties. 
I think we have grown out of our swaddling clothes, that per- 
sonnel work is a distinct personality in the family of professions. 
Personnel work never was an unwanted child for it was bom of 
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a need, a need well recognized by both students and adminis- 
trators It is true that some of our relatives, our academic aunts, 
uncles, cousins and the like, have raised their eyebrows at us, 
but we are now a member of the family, whether always ap- 
proved or not, and we are here to stay. So I am not going to use 
the latter part of the quotation too frequently, for I do not 
think it applies. I am, however, suggesting that certain faults in 
the performance of personnel work lie within us as individuals 
and that we might examine these and learn a bit thereby. 
There is a certain danger in thus cataloging faults, but I shall 
have to risk your displeasure. Sir Walter Raleigh well expressed 
both the danger and the need: “Thou mayest be sure that he 
that will in private tell thee of thy faults, is thy friend, for he 
. . . doth hazard thy hatred, there are few men that can endure 
it, every man for the most part delighting in self-praise, which 
is one of the most universal follies that bewitcheth mankind.” 

Compensations for Lack of Assurance 

Our very lack of assurance, of course, is one of our greatest 
faults. We are too young to be a science and not old enough to 
be a tradition. We are on the way toward accumulating a 
science of practice, and certainly psychology upon which we 
depend can be considered a young science, but upon the whole 
we cannot stand out in an academic gathering with the as- 
surance of the natural scientist, nor yet with the complacency 
of our older academic relatives, such as literature, history or 
the languages. In many a social gathering I have seen this lack 
of self-assurance upon the part of the college personnel worker. 
It is often evident in one of the two familiar patterns in which 
defense behavior is expressed When we are defensive against 
questions that we cannot answer, accusations about which we 
think there may be some truth, or in the presence of such 
ignorance of our work as to give us doubt that it is as important 
as we thought it was, we are apt to respond with either bel- 
ligerent behavior, on the one hand, or apologetic behavior on 
the other. Both, as all psychologists know, are expressions of 
the same sense of inadequacy. 

A belligerent pattern is frequently expressed in an overselling 
of personnel work. This is done by claiming more for student 
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personnel work than it can legitimately perform or by claiming 
outcomes for personnel services for which no proof can be 
offered. This pattern of behavior is common for the younger 
members of the profession who have not yet learned the limi- 
tations of the work in which they are engaged. Nor have they 
learned that such over-salesmanship is resented by professjpnal 
colleagues with whom personnel people must work coopera- 
tively. "It is better to remain silent and appear a fool, than to 
speak and remove all doubt." One does not have to be too 
boastful about one’s self or one's vocation to assure the other 
person that either the person or the vocation is significant. As 
a matter of fact, such boastfulness is often interpreted in 
inverse ratio to the real work of the topic under discussion. It 
has been said that the less a man knows, the louder lie talks 
If he had full belief in the validity of his case, belief that his 
facts spoke for themselves, he would not need to raise his voice. 
"The weaker the argument, the stronger the words." This 
same belligerency is sometimes revealed in an over-sensitiveness 
to criticism of one’s vocation or of one’s own part in personnel 
work. It is again well known that the over-sensitive person is 
merely revealing his basic insecurity. One of our problems in 
this area is that we are not well enough assured of the really 
valid and stable contributions of our vocation so that we can 
readily take criticism of the many aspects of our work that 
justify criticism. 

The opposing attitude, that of apologetic response to criti- 
cisms or discussions of our professional field, is perhaps even 
more reprehensible than the belligerent attitude, for, in so 
being apologetic, we are betraying both ourselves and our profes- 
sion. We have nothing to apologize for in spite of the fact that 
we are doing many things poorly. We should make known that 
we are engaging in a work so complex that we shall never 
perform as well as we should like to do. We must admit failures 
and weaknesses and at the same time be proud of certain 
achievements and basic concepts that will stand up under the 
moat rigorous examination, If we do not have this attitude 
ourselves, how can we expect our colleagues or the public to 
adopt an attitude of respect for the thing which we are doing? 
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I well remember Dean Harold Benjamin some years ago speak- 
ing of the fact that until teachers held their heads up and stuck 
their chins out and said “I am a teacher and proud of it” that 
the teaching profession would never get the respect from the 
public that it deserves. With this I heartily concur. We are 
concerned about the reactions of others to our work, but public 
reaction is in part a reflection of our own estimate of our social 
significance. David Lilienthal, Chairman of the Atomic Energy 
Commission, was recently quoted as saying. “It would seem to 
me that one can, in a rough way, assess the chances that a 
people or a nation will be able to keep its strength and preserve 
its freedom by noting the importance and prestige its people 
attach to teachers and to education.” We must start that, it 
seems, by attaching importance not to the quality of what 
we are doing, but to the significance of the job to be done. 
Furthermore, as I have said, there is much more to be proud 
of than we have sometimes admitted. 

One can honestly say to young people that society, and in 
particular teachers and parents, has done too good a job of 
making them aware of their liabilities and weaknesses. Perhaps 
we, as a young profession, are in the same category. There is no 
reason for us in personal conversations with colleagues or in 
professional meetings to be other than realistic about the work 
that we are doing. This realism consists, in part, of admitting 
our weaknesses, but, also, in stating our strengths. We have 
many more strengths, as a matter of fact, than some of the 
academic disciplines that have prestige because of long life. 
Age does not necessarily bring wisdom. In America we venerate 
old people for what they are, or what they have done, not 
because they are old. For this reason I propose that we accept 
ourselves as a young profession with much to learn, but at the 
same time that we consider it unnecessary to be either belligerent 
or apologetic about the significance of our work. Let it speak 
for itself — with some assistance from us! And, most of all, let 
us accept gracefully criticisms of our personal part in the per- 
formance of personnel work without puffing up our dignity in 
pouter-pigeon fashion or exhibiting more obvious signs that 
our feelings have been hurt. 
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Fatigue and the Blunting of Sensitivities 

A second psychological problem of personnel workers is the 
strain upon the individual of constant contact with human 
beings. No one but teachers and individuals in similar human 
relations occupations appreciate the drain made upon nervous 
energy by the daily routine. For many people, those in the 
academic field have a soft life. We know differently. The only 
trouble is that we know it in such terms that it frequently 
cannot be understood by anyone outside of our own field. I 
am not claiming uniqueness of effort for any purpose of self- 
pity, but drawing attention to the effect of this constant contact 
with people and their troubles, decisions that must be made in 
terms of human reaction rather than objective fact, the neces- 
sity for constantly shifting in terms of the various personalities 
whom we meet from time to time throughout the day, the 
necessity for attempting to see beneath the surface and to 
infer attitudes and conflicts from exterior behavior and verbali- 
zation. These, and other conditions of our work, cause us to 
suffer a kind of nervous fatigue unlike that experienced in most 
other fields. 

This fatigue leads to a peculiar danger of personnel workers, 
the adoption of a kind of surface defense to protect us from the 
results of fatigue. This mask frequently results in a blunting of 
our sensitivity to intimate human reactions. Administrators are 
more often accused of this than are counselors or teachers. I 
think the accusation is probably unwarranted, for the same 
blunting of sensitivity may be expressed not in brusqueness, 
but in inattention or insensitivity which is revealed by a 
wandering of the counselor’s gaze, or the wandering of his mind, 
or in preoccupation with superficialities because he is too tired 
or too lazy to deal with the fundamental human dynamics 
involved. In any event, it is a problem which most personnel 
workers will readily recognize, The solution rests within our- 
selves and our own program of personal mental hygiene. It 
rests with our own program of conserving our energies so that 
the more important things can be handled adequately. The most 
important thing is the reaction and the growth of each indi- 
vidual human being with whom we deal. 
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One of the solutions in this connection is for us to become less 
concerned with paper work and less concerned with personal 
prestige than we are with the significance of the behavior of 
the persons with whom we deal as professional workers. It is 
not easy to ignore a crowded desk and a crowded schedule, to 
appear at ease and wholly absorbed in the self-revelations of a 
given individual, whether a student or colleague. It is not easy, 
but it is essential if we are to fulfill our highest obligation as 
personnel workers. All that we wish to do may be harmed irrepa- 
rably if we establish a reputation of being too busy to see indi- 
viduals with personal problems or too brusque and decisive 
whenever we do see such individuals. 

If we are crowded at our office by people who wish to see us 
and if we, at the same time, must get out certain correspondence 
or perform other essential tasks, then perhaps we should per- 
form these other tasks away from the office, so that our office 
time will not be jammed with affairs not connected with per- 
sonal relationships I find that a couple of hours in the early 
morning before regular hours begin is a great boon for corre- 
spondence and paper work. The telephone is the biggest source 
of irritation and frustration to both the personnel worker and 
those who see him as clients. Some method should be worked 
out by each indivudual wherein the phone does not interrupt 
during the heaviest interviewing periods. If we are truly to act 
as counselors, whatever our personnel title, then we must give 
every indication that our primary concern is with the indi- 
vidual who is consulting with us. And in order to do a good job 
of dealing with that person’s needs, we must give our undivided 
attention to observation of what might be called the clinical 
signs of behavior. To allow ourselves to be licked by the human 
fatigue factor, to become insensitive to the nuances of human 
behavior, is to lose our distinctiveness as specialists in human 
behavior and human need. 

Self-Glorification 

There is a third danger, a temptation to which all personnel 
workers, particularly those who counsel with students and 
younger people, are peculiarly subject This is the temptation 
to become smug and superior in our attitudes toward others. 
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Because the other person comes to us for help and because we 
try honestly to help him, we are apt to feel pretty good about 
ourselves, a little like Jehovah and his children. The client is 
grateful and we have seen him, but we should not take particu- 
lar satisfaction from that reaction. Being bluntly realistic, it 
is our chosen task to help people and there is no particular 
merit in our doing so. All of us like love and admiration from 
others, although sometimes we ask for it a little too obviously. 
When the student or the client gives us gratitude and affection, 
deserved or not, we are apt to glorify ourselves a bit, although 
we would not admit it to anyone but ourselves! This is what 
Wyatt speaks of in a recent issue of the Journal of Consulting 
Psychology 1 when he states that the counseling situation “con- 
tains great potential gratifications, involving corresponding 
risks of frustration and anxiety or indulgence and delusions of 
omnipotence.” He goes on to say that “the higher smugness is 
actually the major vocational disease-risk of the therapist, 
whether it finds expression as that angelic air of patience and 
forbearance in the face of whatever neurotic naughtiness the 
other person is liable to, or that pointed superiority which has 
the answer to all the questions.” He believes that it is hard to 
see how good psychotherapy can be performed without ade- 
quate self-insight by the counselor. This means a realistic 
awareness of the dangers of self-indulgence and self-gratifi- 
cation. 

One way to keep one’s self from this particular psychological 
temptation is to constantly remind one’s self of the social 
obligations and social aims of personnel work. Our job is to 
help individuals become more effective and integrated members 
of their current society. The fact that they are grateful for our 
helping them in this regard is of little moment. The real point 
is that it is our job. If we are completely honest we will admit 
that what we do for others is seldom done as well as we should 
like or well enough for us to feel complacent about it. Another 
thing to consider is that much of the value to the student comes 
from his own reactions to himself rather than from anything 
that we have done. The very act of coming to a counselor is a 
favorable prognosis. Some of the values of the counseling ex- 

1 Wyatt, Frederick. "The Self-Experience of the Psycho therapist,** Journal of Con- 
sul ting Psychology t XII (1948), 84-8 <; 
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perience are almost completely independent of our personality 
or of our techniques because they are involved in the client’s 
decision to consult a counselor. I am increasingly convinced 
that we have placed too much stress on techniques and not 
enough upon the interaction of the two personalities in the 
counseling situation. The interaction of these two people may 
bring a considerable degree of the benefit to the counselee 
without regard to what either one may have consciously done 
or of the particular techniques employed by the counselor. The 
student may have benefitted in this way — we do not know that 
he did. In fact, so little is known of how counseling benefits 
others, that all of us who counsel would do well to take little 
credit for ourselves. 


Discouragement 

Now to look at a fourth psychological problem, one previously 
suggested by Wyatt. This is the opposing danger of self-dis- 
paragement and discouragement over the enormous complexity 
of the human problems faced by any personnel worker. Here I 
am speaking not only of counselors who spend most of their 
time dealing with students, but of personnel workers who 
counsel with colleagues or who are responsible for colleagues 
in their own institution. Because we have the title “personnel” 
attached to us, it is assumed that we are interested in people 
and their welfare, and, for this reason, many problems come 
our way which are not necessarily those of a student-counselor 
type. If our interest in people is a thoughtful interest, we are 
frequently discouraged at the enormity of the need, on the one 
hand, and the smallness of our possible contribution, on the 
other. Of course, we frequently expect too much of ourselves. 
We frequently forget that growth in any essential characteristic 
takes time and that no one or two interviews are going to change 
a person’s life unless we can assume that certain dramatic 
cases that have been publicized in literature are common occur- 
rences. We frequently become emotionally involved in the 
client’s problems and identify ourselves closely with him. In 
this we lose one of the great advantages of a professional 
counselor, his ability to remain objective and neutral in spite 
of the client’s perturbation. 

We must constantly tell ourselves that the goals of counseling 
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are limited and that we cannot remake a person’s life. We 
merely assist him in one connection. We furthermore must 
know that what we are trying to achieve is a process of re- 
education of the individual, that is, helping him to re-educate 
himself, This is not done quickly. It takes time to translate a 
change of attitude into a change of behavior. If we are realistic 
about ourselves and our job we will not assume that we are 
going to make great changes in a person’s life, and we will, 
therefore, not be discouraged over a lack of achievement. The 
counselor is but a tool or a catalyst in the life pattern of the 
individual with whom he is dealing at the •moment. Many 
other factors are present; he is but one. He can neither take 
credit nor blame for all that happens. 

Perhaps one of our peculiar liabilities arises out of this limi- 
tation. This is the liability of never actually feeling mastery 
over situations. The intricacies of human nature are so great, 
the bulk of what we do not know is so large, the rapid growth 
of new knowledge so perplexing, that we never seem to feel 
that we are doing a complete and thorough job in any of our 
human relations responsibilities. One of the perplexing things 
for those of us who have been in the field for some time is that 
the thing which we once thought right is now considered wrong, 
or is, perhaps, proved wrong. This, of course, is not unique to 
our field of endeavor. It is true in medicine and many other 
areas, but it seems to hit us with peculiar force. Wc are, of 
course, still top-heavy on the theory side of our work, and for 
this reason can easily be swayed by new concepts which seem 
to indicate that our previous thinking has been wrong. These 
concepts frequently lack proof. We must guard against being 
too disturbed by new ideas until we can find evidence to support 
those ideas. This is not to suggest that we should not willingly 
change. We must change, and readily, but let us not be too 
disturbed about rapid change because really justifiable change 
demands evidence. We can sometimes say, “That’s an interest- 
ing thought; perhaps I was wrong. I will proceed more cau- 
tiously, but I won't accept this as new truth until I see the 
evidence for the new point of view.” I think this matter of 
never feeling complete mastery over a situation or never feeling 
that we are right without equivocation is one of the penalties 
of dealing with intricate human behavior. We must simply live 
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with this particular liability. We will probably never dispense 
with it. 


Strain of Indecision 

Another of our peculiar problems is that of being so frequently 
undecided as to the best course of action. The strain of in- 
decision dogs the steps of all, of course, who deal with decisions 
which are important in human lives. Psychological counseling 
and any of the professional personnel functions that deal with 
human decisions are particularly subject to this strain of in- 
decision and for a specific reason. Our problem is always that of 
“how far shall we go in transmitting to the other party our 
convictions with regard to his best course of action? — how far 
shall we attempt to load the dice in terms of a particular 
alternative by the way in which we discuss the alternatives 
or by our very tone of voice? — how far shall we simply keep 
quiet and allow the individual to work through completely on 
his own?” If we know something about the individual which 
may be either advantageous or discouraging, what shall we tell 
him of this and how shall we tell him? What will be the affect 
upon him of this method of presentation as opposed to that? 
These are the questions that trouble us and bring about, it seems 
to me, an unusual amount of strain upon the part of those who 
are conscientiously trying to work with individuals in terms of 
facilitating the process of growth within the individual himself. 
We may know what is best for the student or best for our col- 
league, but our knowing it will never solve the problem for him. 
The real situation is solved only when the individual concerned 
finds for himself a resolution of conflict, a best way out, a 
changed attitude 

Indecision as to the best course of action is a great strain 
upon our own emotional maturity and our own sense of balance 
It is a test of our objectivity regarding the other individual, our 
complete self-abnegation or selflessness, our ability to exist with- 
out any ego-support from the counseling situation. 

The T emptation of Authority 

In speaking tonight of the personnel worker, I am stressing 
the point that he or she is, without question, the most important 
element in the personnel program. Henry Murray has spoken 
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of “psychology's forgotten instrument — the psychologist.” 
Rapaport 2 lists four factors essential to the understanding of 
diagnostic information: the basic personality theory that is 
held, test rationale, familiarity with previous research, and the 
self-knowledge of the counselor. He writes that “the richest 
source book of psychological understanding is carried by the 
individual within himself,” that through a process of self- 
examination and heightened self-awareness as an instrument in 
the psychological process, we can develop greater sensitivity to 
the meaning of information about human behavior. All of this 
is just as true about the personnel administrator. About one- 
half of the membership of ACPA is classified as personnel 
administrators, and certainly they have no more important 
function than the consideration of the personnel worker, his 
qualifications, his welfare and his progress. If the personnel 
administrator gets too much engrossed in programs and forms, 
in public relations and budgets, he misses his chance to make his 
greatest contribution to the personnel work of his institution — 
the development, encouragement and support of the personnel 
workers subordinate to him. 

Administrators, as such, have rather distinctive psychological 
problems. In the first place, many administrators such as Deans 
of Men, Deans of Women, or Deans of Students, actually have 
authority over the lives of students, and the temptation is to 
use that authority in ways that will facilitate a given situation 
but which may not necessarily be best for the student con- 
cerned. You and I have known administrators who were quite 
arbitrary in dealing with students. Having the authority, they 
used it partly as a source of self-gratification and partly to make 
things move smoothly as far as the institution or the group was 
concerned — but all to thedisadvantageof theindividual student, 
all to a retardation of his growth and a sense of resentment upon 
his part. 

Part of this arises from the administrator’s tendency to look 
at the outcomes of programs rather than at the outcomes in 
the lives of individual students. Part of it may come from the 
fact that he is frustrated at times in dealing with his colleagues 

* Rapaport, David. "The Status of Diagnostic Testing.” Journal qj Consulting 
Psychology. XII (1948), 4-7. 
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or with his superiors in the academic organization, and this 
frustration leads to arbitrariness with students or with sub- 
ordinates, the only people with whom he can be arbitrary. Our 
most dangerous time m dealing with individuals who are in any 
sense subordinate to us is just following some frustrating ex- 
perience upon our own part. The phenomenon of projection is 
too well known to demand emphasis here, but it is not too 
readily recognized by the person exhibiting the mechanism. I 
am convinced that students who have come to me with a bitter 
recital of treatment from some personnel administrator had 
suffered because that administrator himself had just been 
treated rather harshly by someone else or by certain circum- 
stances in life The reason for his treatment of students was easy 
to see, the justification for it not so easy to see. Administrators 
are supposed to take the raps, but they are not supposed to 
pass them on to those under them. This is a peculiar temptation 
of anyone who stands in positions of responsibility. 

The administrator may be engrossed in a complex program, 
but he cannot forget that impersonal manipulation of staff 
personnel, no matter how immediately helpful to program de- 
velopment, will only result in lowered morale for these and 
every other staff member who hears about it. The tolerance of 
leader domination of group activity seems to increase with the 
size of the group, as found by Hemphill in the Ohio State study 
of leadership, but even here the efficiency of result may decrease 
in spite of tolerance. The power factor, the authority complex, 
the advancement of program at whatever cost to staff security, 
is the worst and riskiest kind of personnel administration. 

There is excellent argument for an emphasis upon a clear-cut 
line-and-staff organization of the student personnel functions 
and staff of an institution The administrator in higher edu- 
cation must remember, however, that he is dealing with indi- 
viduals on a staff who are often not his intellectual or profes- 
sional subordinates, but his colleagues. They are as competent 
as he in their respective fields and are his intellectual equals. 
For this reason, he cannot be arbitrary with them orheloses their 
greatest value to him and to the institution. In policy making 
and in the initiation of new ideas, they must work with him 
and not for hirm I have written elsewhere" s . the student 
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personnel program should operate under policies established by 
an agency representing the administration, faculty and the 
students," and "Student personnel procedures do not function 
well under an administrative fiat arrangement.'’* 

Misinterpreting the Administrator's Relationship to his Staff 

Another problem of administrators is their frequent failure 
to recognize that in dealing with the staff they are not dealing 
with students but are, at the same time, responsible for people 
who have common human need for counsel and encouragement. 
For some curious reason, most people like to move from teaching 
or counseling positions into administrative positions. The pres- 
tige factor is an important one in a decision to assume adminis- 
trative responsibilities as is the realization that certain things 
could be done with the program if the individual had more 
control. When this move is made, however, the thing which is 
frequently not realized is that one must change within himself 
when he changes from teaching or counseling to administration. 
He or she has far fewer contacts with students, and the people 
who take the place of students in his life are the people who 
work with him and for him. They should be treated with the 
same consideration and with the same psychological carefulness 
that he has been accustomed to use in dealing with students. 
Now he is engaging in a process of adult education and counsel- 
ing. He is responsible for staff intellectual and emotional growth, 
their independence, their morale. Williamson 4 states that “de- 
veloping counselors" is one of the three major objectives of a 
program of supervision of counseling services. He writes, "The 
counselor, himself, is as often as much in need of counseling as 
the client is, and any administrator that forgets that is not a 
good administrator," "... in administration we almost refuse 
to do for the doctor what the doctor does for his patients.” 
Such psychological blindness is not worthy of administrators 
in such a human-relations function as the administration of 
student personnel services. 

Perhaps it is hard to be both an administrator and a coun- 

* Wrenn, C, Gilbert. 'The Administration of Counseling and Other Student Per- 
sonnel Services.'’ The Harvard Educational Review, May, 1949. 

1 Williamson, E. G. "Supervision of Counseling Services." ’Journal of Consulting 
Psychology, VIII (1948), 197-31 1. 
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selor. Dean Clifford Houston, in writing to me of the work of 
his Committee on Professional Standards, makes the following 
observation: “One does not draw conclusions from so few cases, 
but it is becoming very obvious that the personal and profes- 
sional qualifications of a good counselor are not always identical 
with those of a good Dean of Students. Leadership and per- 
suasiveness are very important characteristics for the latter. 
On the other hand, the careful research type of psychologist 
might find it difficult to become a real influence with the inter- 
fraternity council.” I might add that we really expect a great 
deal of the personnel administrator' 

If the personnel administrator states that he is concerned 
with the morale of the students in his institution, he must first 
be concerned with the morale of the stajf members who deal 
with those students. His primary responsibility is to his staff 
and through them to his students. This is not an easy thing 
to accept, particularly if one likes to deal with students. One 
is apt to relegate staff to a position of subordinate responsi- 
bility, but this the administrator cannot and must not do. It 
further follows that too frequently the administrator, because 
of his position and varied responsibilities, becomes insulated 
from student life and student thinking. He is unwilling to admit 
this, and all too frequently speaks of student reaction in terms 
of student reaction at the time when he was dealing intimately 
with students, not student reaction as it may exist today. He 
must depend, therefore, much more heavily upon the reaction 
of his staff, because they are the ones who are dealing with 
students hour after hour and day after day, and may know 
more of student reactions than he does He must depend upon 
these staff people for their interpretation of student needs. Yes, 
the administrator has difficult enough problems in terms of 
developing his program and keeping his various bosses satis- 
fied, but that is nothing to the problem he has in dealing ade- 
quately with his staff. 

I have said nothing here of the difficulty faced by the person- 
nel administrator by virtue of student reaction to his title, 
whatever it may be. This is serious enough in the case of the 
“ Dean,” for this word carries with it a connotation of authority 
and officialdom that the personnel administrator would like 
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very much to avoid. This is a problem, to be sure, but it is in no 
sense as serious as tile one I have earlier mentioned, namely the 
difficulty the personnel administrator has within himself in 
terms of how he actually treats students now that he is an 
administrator, and how much importance he assigns to his 
relationships and responsibility for staff welfare. 

Let me recount what 1 have been saying. I have suggested 
that college personnel workers face such psychological problems 
and temptations as the following; 

I. The exhibition of compensatory behavior because of a 
fundamental lack of assurance of the status of personnel work, 
particularly such compensatory patterns as belligerency and 
cockiness on the one hand and an apologetic attitude on the 
other. 

1. A blunting of one’s psychological sensitivities because of 
constant and repetitious human contact. 

3. The tendency toward smugness and self-glorification be- 
cause of client dependence and gratitude. 

4. The opposing danger of self-disparagement and discour- 
agement because of the complexity of human behavior. 

5. The liability of the strain of indecision and uncertainty as 
to the most constructive course of action in dealing with a 
client or staff member. 

Among administrators I have suggested: 

I. The temptation of over-using or misusing authority be- 
cause attention is placed on program outcomes rather than on 
the process of growth in a person. 

1. Forgetting that the administrator’s chief responsibility is 
toward his staff and through them to students. 

This might sound as though I were overly aware of psycho- 
logical problems in the life of the personnel worker. Perhaps 
what X have been doing is reflecting the problems in my own 
life at various stages in my development, and I may have had 
more difficulties than the average person. There seems to be 
some basis, however, for believing that these problems and 
temptations of the personnel worker are common to many. 
What, then, can be done about them? Is there anything that 
could be suggested that would help point the way for a person- 
nel worker to become more effective in dealing with these 
intimate psychological factors in his life? 
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Mental Hygiene for the Student Personnel Worker 

One might use a basic approach and examine the factors *that 
cause tensions in our lives. This has been ably done by Lewin 
in several of his brilliant essays collected under the title Resolv- 
ing Social Conflicts , 5 But I will only refer you to Lewin and 
will not attempt to even be scholarly enough to discuss his 
contribution. This would be a bit aside from the simple purpose 
of this paper. Such detours are not popular. A visitor from 
Scandinavia arrived at Salt Lake City delighted with his rapid 
trip thus far. A friend asked "How were the roads, Hans?” 
“Val, dis man Lincoln was a great highway engineer. But dat 
Frenchman deTour, he was no road-builder at all.” 

If it is not presumptuous, let me suggest some simple rules 
of mental hygiene that may be appropriate to each of us as 
personnel workers. These suggestions are for me even more than 
for you. All of you remember the two small boys who were 
bristling up to each other in rooster-fashion. One was quite 
capable of bringing out a long string of insulting remarks. The 
second boy remained quiet and broke in only when the first 
had paused for breath. He remarked only this, but it took the 
wind out of the other’s sails! "All them things you said about 
me, you is, ’cepting they goes double for you.” So all those 
things I say about personnel workers, and all of the suggestions 
I make about mental health, go double for me. 

The first thing to suggest is that we attempt to have fun 
from our associations with people. I feel that sometimes we 
take people, and their relationships to us, too seriously. We 
become involved in what they think of us, or become involved 
in their troubles, and much of the actual joy of human com- 
panionship is lost All of us know people who are casual and 
relaxed in their relationship with us and we enjoy being around 
them. All of us know people, on the other hand, who are so 
tense in their attempt to promote their personal programs that 
we are unhappy around them. Perhaps we could adopt a prin- 
ciple that we might learn more from others and instruct them 
less frequently. This would put us in a different relationship to 
many people, particularly our clients and our associates. None 
of us should have entered the field of personnel work unless we 

• Lewin, Kurt. Resolving Social Conflicts. Harper and Brothers, 1948. (See especially 
pp. 89-90,) 
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had enjoyed constant personal contact with people. This enjoy- 
ment may have been evident in the beginning, but now some of 
us have become so engrossed with programs, public relations 
publications, and promotions that the joy we once had from 
simple human contacts has been greatly diminished. When this 
has happened, we become less effective in all of our personal 
relationships. People enjoy less being around us, since we enjoy 
less being around them. Any uniqueness we may have had as 
far as understanding and sensitive personality is concerned, has 
been merged in the common pattern of personal ambition and 
drive. I suppose that one way to put it is to say that many of us 
take ourselves too seriously and in this engrossment of self we 
miss much of the pleasure of life. 

A second point is that we should recognize our fatigue points 
and deliberately avoid any extensive contact with people once 
that point has been reached. Wecertainly are not effective after 
we have reached this fatigue point. It is at this time that our 
voices become sharp, our attention wanders, our patience with 
the slow progress of others falters, and our effectiveness drops 
to the vanishing point. This fatigue point will be different 
with each individual. All of us know that various fatigue studies 
have indicated high fatigue points at about 1 1 o’clock in the 
morning and 4:00 in the afternoon. This, of course, is for 
people who keep regular office or factory hours. For others, the 
fatigue point may come either earlier or later, but it is our 
personal problem to select our own fatigue point. Furthermore, 
we must learn to recognize the symptoms of that approaching 
state of tension. Perhaps only a brief respite is necessary to 
reduce the fatigue and tension. For some this respite is in a 
candy bar. Others read something light, and still others will 
look out the window. Someone else may stretch for a few 
seconds or take a deep breath. All of these have a combined 
effect of releasing our physical tensions and at the same time 
bringing new associations into our intellectual existence. We 
break the synapse, so to speak, of well-established paths and 
by this process apparently reduce our tension level. 

A third suggestion is that we stop setting up impossible 
goals for ourselves in terms of the amount to be accomplished 
each day. If we plan on less than we actually expect to do each 
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day, the unexpected things that always arise will fill in the 
chinks of our time without strain. We almost always , on the 
contrary, plan on more than we can do and then feel frustrated 
and unhappy because the impossible has not been accomplished. 
We could stop making dates for all of our spare time weeks 
ahead, knowing that other demands on our time will be made 
between now and then and we will feel obligated to keep the 
previously made dates as well as to add new ones. If, for 
example, we know that we can make outside trips or speeches 
twice a month without strain, we could develop a habit of 
making only one date a month as far as two months in advance 
knowing we would always have some requests later that would 
take up the second date. There is not time here to discuss the 
interesting psychological mechanism that impels us to set up 
these impossible time schedules, but set them up we do They 
are certainly not good for ourselves and not good for the people 
with whom we are in social contact. 

A fourth possibility is a habit of blocking out a small amount 
of professional reading each day and thereby reducing the 
feeling of frustration that we develop because we are not 
making professional progress. Most of us know that we have 
several hours reading ahead of us each day and seldom get 
more than a fraction of it done. Our journals pile up. The books 
that we have to review become older month by month. Our 
professional writing suffers and even our correspondence peri- 
odically goes to the dogs. We could block out a schedule of one- 
half hour a day of professional reading and strictly observe that 
minimum. By this procedure we would be making slow but 
steady progress on a schedule that we could actually accom- 
plish. This feeling of frustration because of professional matters 
leaving us behind is one that we can lick, but not on an impos- 
sible perfectionist basis that most of us dream about. 

The fifth point that I should like to suggest is that we deliber- 
ately practice small courtesies in our relations with other people. 
In the first place, it is easier on others and will pay large 
dividends in social effectiveness. In the second place, by practic- 
ing these small social courtesies, we are actually demonstrating 
that we believe in the integrity of each human personality 
with whom we deal. This point is not easy to express, but I am 
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trying to say that if we practice courtesy and consideration for 
the welfare and dignity of the other person in small affairs, then 
it will be easier for us to measure up to our ideals in major 
human relationships. Courtesies in crowded traffic, in stores, 
in restaurants, or remembering birthdays and personal honors 
that have come to our friends seem small indeed, but it is of 
such small incidents that our major patterns are made. Many of 
us preach a high-sounding social responsibility, but actually live 
in a niggardly fashion as far as our day-to-day social contacts 
are concerned. 

Finally, I would like to suggest that we should remember that 
ultimate values persist regardless of what happens to our per- 
sonal lives. Things that we believe in, that have permanent 
significance, do not change no matter how much the world 
about us seems to deteriorate. We may be personally in a 
minor position and we may suffer in comparison with others. 
We may have little in the way of goods or money. Prices may go 
up, and our state legislators may rob the schools to pay bonuses 
to veterans and pensions to the elderly. The United Nations may 
lose its prestige and wc may have grave fears about our policy 
with regard to the atomic bomb. But in the face of all these, 
certain basic values do notchange. Human rights and dignities, 
the integrity of each human personality, the warmth of love 
and friendship, the beauty of the earth, the eternal significance 
of the spiritual, — these things endure. The physical and the 
political world about us may cause suffering of body and mind, 
but the things of the human spirit do not die and it is with 
these eternals of human life that we must be concerned if we 
are to live up to our high calling as specialists in human rela- 
tionships and as trustees of human values* 
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The interest of the American Council on Education in stu- 
dent personnel services throughout the years is clearly re- 
flected in its publications, its special projects, and in the activ- 
ities of its Committee on Student Personnel Work. Inasmuch 
as previous reports have been made on these various interests 
and activities, this statement is confined to recent and current 
developments that are assumed to be of special interest to 
this group. Among the Council’s publications directly related 
to personnel work are the following : 

1. American Universities and Colleges and American Junior 
Colleges. These are new editions of volumes that have been 
published regularly at four-year intervals, with the exception 
of the 1944 edition which was omitted because of abnormal 
conditions affecting higher institutions during the war. They 
are designed to provide up-to-date information about accredited 
higher institutions for the use of high-school Guidance Officers, 
Directors of College Admissions, College Counselors, admin- 
istrative officers or faculty members, and of business and in- 
dustrial personnel officers who have need for special informa- 
tion about colleges and universities. The growing demand for 
this information is indicated by the fact that within approxi- 
mately 12 months more than x 1,000 copies of A.U.&C. and 
more than 6,000 of A.J.C. have been distributed. 

2. Universities oj the World Outside U. S. A. This is a new 
undertaking. It is a direct outgrowth of the rapidly expanding 
program of international exchange of students, teachers, and 
research scholars. Many individuals and agencies expressed 
to the Council an urgent need for a handbook on institutions 
in other countries comparable to the volume, American Uni- 
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versifies and Colleges . The project was undertaken only after 
a thorough-going investigation of the need for such a volume 
and of the feasibility of preparing it. The Carnegie Corporation 
regarded it to be of sufficient importance to make a substantial 
grant toward its preparation. It will contain full descriptive 
exhibits for more than 700 post-secondary institutions through- 
out the world and additional briefer listing of 1400. The pub- 
lication date is January l, 1950. 

3. Brochures. I shall not take time to pay a greatly merited 
tribute to the Council’s Committee on Student Personnel Work 
and its various subcommittees that have given valuable time 
and service in the preparation of brochures and the exploration 
of problems in the field of student personnel services. The 
brochures which have been prepared by the Committee are 
widely used for the in-service training of counselors, as source 
materials for graduate students preparing for personnel work, 
and by administrative officers in organizing and evaluating 
their personnel programs. The brochures recently published or 
currently in process of publication are: 

'■The 1 Teacher as Counselor (/pyd) 

Graduate Training for Educational Personnel Work 
Helping Students Find Employment 
Predicting Success in Professional Schools 
Student Personnel Point of View ( revised ) 

Other special Council projects that are directly in the field 
of personnel work or closely related to it are these: 

I, The Advisory Service on Student Personnel Work. — Refer- 
ence has been made at previous meetings of this Association 
to the arrangement whereby with the aid of a subvention from 
the Hazen Foundation the services of Counsultants on student 
personnel problems and programs are available to colleges and 
universities at their request. No extensive publicity has been 
given to this service because the number of requests in response 
to two brief mimeographed statements sent out in the last 
three years has been greater than could be provided for within 
the personnel and resources available. 

During the present academic year Consultants will have 
visited between aj and 30 colleges and universities. Ever mind- 
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ful of the possibility that the net results may not justify the 
expenditure of time, energy, and money involved, efforts have 
been made to evaluate this program. Presidents and deans have 
been invited to comment either in conferences or by letter. 
A special meeting of Consultants and the Subcommittee in 
charge of the program was devoted to a critical appraisal, and 
an analysis has been made of the written reports submitted 
by the consultants for the purpose of discovering points of 
greatest concern to the institutions and the most effective 
methods employed by the consultants. To attempt to sum- 
marize the tentative conclusions arrived at by these several 
procedures would require far more time than I have at my 
disposal. Suffice it to say that this has been a vital educative 
process for the consultants as well as for the institutions. 

Whether this Advisory Service will be continued beyond this 
year remains undetermined. 

2 . Factors Affecting the Admission of High School Seniors to 
College. — The subject of discrimination against minority groups 
by colleges and universities is being widely discussed. The 
Council’s exploration of this problem was focussed on the 
difficulties that qualified high-school graduates in minority 
groups encounter in gaining admission to college. It took the 
form of a careful sampling and interview procedure among the 
high-school graduates of the academic year 1947—48. The re- 
sults of this study are now published, so I shall not undertake 
to summarize them. 

3. Study of Disabled Veterans in Colleges and Universities — 
This study was initiated about two years ago at the request 
of the national organization of the Disabled American Veterans. 
Periodic reports have been published of the findings as the 
study progressed. These reports have contained a number of 
conclusions that are especially pertinent to counselors and 
personnel officers in higher institutions. A final report is in the 
process of preparation and will be published shortly. 

4. I" he Impact of Veterans Counseling Centers on Student 
Personnel Services. — Inasmuch as the report of the study made 
by Dr. Mitchell Dreese under the Council’s auspices has al- 
ready been made at this meeting of the American College 
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Personnel Association, it is unnecessary to go into any detail 
about it. The subject is a timely one, and the Council was 
gratified to find that Dr. Dreese had a special interest in it 
and had some free time which he generously gave to the study 
without compensation. It is our hope that his report may be 
the means of creating further interest on the part of institutions 
in conserving the beneficial elements of their experience with 
the veterans counseling centers. 

5. The Conference Board 0/ Associated Research Councils . — 
The American Council on Education is not the only national 
organization concernedwith personnel problems. The Conference 
Board just referred to is composed of representatives of the 
American Council of Learned Societies, the American Council 
on Education, the National Research Council, and the Social 
Science Research Council. One of the problems of special con- 
cern to the Conference Board is the impending deficit in pro- 
fessional manpower and the resources in our high-school and 
college population for supplying this deficit. Several prelimi- 
nary studies have been made to identify the data available on 
aptitudes of high-school graduates and college freshmen, to 
determine the level of aptitude required for successfully pur- 
suing advanced graduate study, and to identify sources of in- 
formation about highly qualified professional personnel. A much 
larger project for the purpose of pursuing these and other issues 
further is now pending. It is needless to say that these issues 
have direct and far-reaching implications for counselors at 
the high-school, college, and graduate levels. 

6. Contracts jor Research on Scientific Naval Personnel. — On 
the initiative of the Office of Scientific Personnel, Office of 
Naval Research, the Council has undertaken, under contract, 
several important research projects that lie directly in the per- 
sonnel field. These projects relate to such special subjects as 
job analyses to determine the kinds of competences required 
for research positions in the Navy; the characteristics of pro- 
ductive scientists; the development and selection of instruments 
to measure scientific aptitudes; the construction and valida- 
tion of recommendation forms for scientists; management of 
scientific personnel. 
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All of these studies have direct implications for procedures 
and counseling, selection, and placement of individuals in our 
colleges and universities who look forward to positions involving 
research and leadership. 

This catalog of activities, while not exhaustive of all the 
projects that have a hearing on student personnel work, will 
be sufficient to indicate the Council’s deep interest in this field 
and the directions in which these interests are being pursued. 



PERSONNEL SNAPSHOTS— SIGNIFICANT DEVELOP 
MENTS IN THE VOCATIONAL REHABILITATION 
PROGRAM AFFECTING STUDENT PERSONNEL 
WORK 


D. H. DABKLSTEIN 

Assistant Director, Office of Vocational Rehabilitation, Federal Security Agency 

Washington, DC. 

Significant developments which have taken place in the 
vocational rehabilitation program are so numerous, and cover 
such anextensive range of subject matter, that it is exceedingly 
difficult to select those which might be of the most interest to 
this group. I have limited myself, therefore, to those which 
are quite general and might be presented within the limited 
time available. 

Vocational rehabilitation of disabled civilians is perhaps one 
of the oldest publicly supported guidance or personnel programs. 
Beginning in ipao the program provided disabled persons of 
employable age with guidance, vocational training and place- 
ment services as a means of preparing them to become self- 
supporting and useful members of society. It is obvious that 
with such a limited variety of services only a selected portion of 
the physically disabled could be prepared for and absorbed in 
the labor market. Recognizing the limitations inherent in the 
original program, Congress in I943 enacted certain amendments 
which authorized the provision of "any services necessary to 
render a disabled individual fit to engage in remunerative em- 
ployment.” Briefly these include medical, psychological and 
psychiatric evaluation; guidance; personal adjustment; pre-vo- 
cational and vocational training; placement; and under certain 
conditions medical and psychiatric care, surgery, hospiial^atio-.. 
subsistence, transportation; occupational tools, becomes au.i 
equipment. In addition to increased financial support for the 
program, the disabled were defined to include the mentally as 
well as the physically handicapped. 

3*4 
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My purpose in identifying these services is to indicate that 
the vocational rehabilitation program for disabled civilians has 
been developed to the extent whereby it now has become one of 
the most comprehensive and complex programs of vocational 
adjustment. Broadly defined, vocational rehabilitation means 
accepting a physically or mentally handicapped individual as 
he is and seeing him through to the best vocational adjustment 
of which he is capable. As such the program not only requires, 
in the day to day operation, all that is contained or intended in 
the traditional definition of vocational guidance, but one 
which also invests public funds in its predictions and recom- 
mendations. 

In spite of the large variety of services whichmay be purchased 
for eligible clients, guidance or counseling continues to remain 
the basic structure of the program. The effectiveness of services 
selected and the future welfare of the disabled individual and 
his dependents is contingent upon the quality of this service. 
Rehabilitation counseling differs from usual counseling briefly 
in several major ways. First, in the degree of special applica- 
tion of general counseling information and skills. Rehabilitation 
Counselors must be trained to diagnose and to understand the 
effects and implications of physical and personality deviations 
upon medical services, training, morale, and successful job 
placement. 

Secondly, vocational rehabilitation is one of the few pro- 
grams in which the Counselors have a continuity of responsi- 
bility that extends from referral through selection of an objec- 
tive, preparation for the objective which is financed by the 
program and continues until suitable vocational adjustment is 
achieved. Finally, since disablement strikes at all economic, 
intellectual and age levels, the case-load of the average Counse- 
lor consists of a cross-section of society. 

Paralleling this expansion of the program has been the in- 
crease in the number of professional employed and those who 
will be employed during the future. Prior to 1943 less than 500 
professional personnel were engaged in the program in the 48 
States, Territories of Hawaii, Puerto Rico, Alaska and the 
District of Columbia. Most recent reports indicate approxi- 
mately 1700 professional workers currently engaged. 
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During the past fiscal year about 54,000 disabled persons 
were rehabilitated and it is estimated that the number will 
reach 65,000 by the end of the present fiscal year. The Federal 
Security Administrator in his report to the President on a 
"Ten Year Program for the Nation’s Health” has set a goal 
of 550,000 rehabilitations per year by i960. This goal approx- 
imates the number who each year become disabled to the ex- 
tent of requiring rehabilitation services, to enter or return to 
employment. Although a determination of the specific number 
of qualified personnel required to achieve this goal cannot be 
made at this time, it seems reasonable to assume that the 
number might well exceed 4,000, The State -Federal vocational 
rehabilitation program in itself will therefore constitute a sig- 
nificant area of personnel work. 

A third development which has taken place actually results 
from the absence of adequate professional training programs or 
opportunities for Vocational Rehabilitation Counselors. With 
but few exceptions, institutions of higher learning have not 
yet fully recognized what we think is their responsibility in es- 
tablishing a curriculum, particularly at the graduate level, for 
this field of work. The exceptions are: Ohio State, Wayne 
University, New York University and to some extent, the 
University of Minnesota. Special short courses have been of- 
fered at Penn State, Colorado A & M, Hampton Institute, 
University of Washington and Michigan State Normal College. 
The result has been a serious shortage of trained Rehabilitation 
Counselors. Our only alternative, therefore, has been to recruit 
personnel from related fields such as education, social work, 
psychology, industry, and the like, and to organize a dynamic 
and comprehensive program of staff development or in-service 
training. 

Time does not permit a description of the staff development 
program. The program is continuous; it covers a wide variety 
of specialized subject matter and utilizes the methods common 
to other in-service training programs. I have a few pamphlets 
here which describe a few of these accomplishments. 

I would like to mention briefly one such program for Super- 
visors of Counselors which is at present in the process of being 
organized. Briefly, the program is patterned after the several 
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organized for doctors by the Commonwealth Fund and de- 
scribed in their publication, Human Relationships in Public 
Healths The program content will be organized around the 
area of interpersonal relationships in the supervision of Coun- 
selors. The Staff will include Psychiatrists, Psychiatric Social 
Workers, Clinical and Applied Psychologists and one or two 
persons who have had considerable experience in supervising 
highly qualified Counselors. The ratio will be not more than 
three students to one faculty member. Lectures will be kept 
to a minimum and most of the work will be carried on in small 
groups and through demonstration and participation. The en- 
tire group will work, eat and be together for an entire 8-day 
period. 

In addition to a staff development program we are attempt- 
ing to establish standards of performance for Counselors which 
in turn may be used to evaluate the quality, particularly of the 
counseling area, of our program. We have used such indirect 
methods as follow-up, clients’ opinions and the like, all of which 
have been of considerable value. We have long felt the need, 
however, for developing in written form what actually consti- 
tutes minimum standards of performance for the various areas 
of case study, counseling, case recording, and similar factors in 
order that the counselor might have some criteria against 
which he might compare his own performance. Furthermore, 
such standards are useful in attempting to evaluate the quality 
of counseling services being extended disabled persons in the 
various State programs. It also serves to point up the training 
needs of the counseling Staff. These materials are still in the 
developmental stage but nevertheless are proving very effec- 
tive in stimulating State personnel to improve the quality of 
their services to the handicapped. 

Finally, the need for research is as urgent in the vocational 
rehabilitation program as it is for other personnel and guidance 
programs. The document by Barker, Wright and Gomick en- 
titled, Adjustment to Physical Handicap and Illness j is, m my 
opinion, one of the most significant publications in the field. 
Rather than report on the studies which have been undertaken 


1 Published by the Commonwealth Fund in New York, 1949 
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by the Office of Vocational Rehabilitation or are presently 
underway, I would like to mention an approach we are develop- 
ing to encourage and stimulate research investigation by agen- 
cies or institutions other than our own. We have recently or- 
ganized a National Committee of experts whose major functions 
will be to encourage, advise and coordinate psychological re- 
search for the blind. As a first step the Committee is making 
an inventory of psychological research on blindness now. 
As a second step the Committee plans to outline needed 
research projects, including methodology, which will becompiled 
and distributed to universities, colleges and foundations as a 
means of stimulating interest and action. Finally, the Commit- 
tee will serve as a clearing house for those who may wish expert 
advice or direction with respect to their own research projects 
in this field. We feel that this Committee will serve a real pur- 
pose in stimulating needed research which might contribute 
to the welfare of the blind. I am sorry that time does not 
permit acquainting you with equally important developments 
in this field. 



PERSONNEL SNAPSHOTS— SIGNIFICANT DEVELOP- 
MENTS ON THE NATIONAL LEVEL AFFECTING 
STUDENT PERSONNEL WORK 


HARRY A JAGER 

Chief, Occupational Information and Guidance Service, Office of Education, Federal 

Security Agency 

I welcome the opportunity to represent the Occupational 
Information and Guidance Service of the Office of Education 
at this meeting of the American College Personnel Association. 
Although the Occupational Information and Guidance Service 
is chiefly concerned with improving guidance services in non- 
collegiate institutions, it recognizes and participates in impor- 
tant interrelationships. Just as your influence extends beyond 
the college level into the high schools and into the community, 
the activities of our Service have implications for personnel 
workers in colleges I shall describe briefly several ways in 
which the activities of our Service and its cooperating State 
services impinge on your field. 

Within the past year there has been a significant increase 
in the number of active State programs of supervision of guid- 
ance services This increase will, we believe, result in better 
guidance services being available in the secondary schools of 
the Nation. High-school students will, as the quality of the 
service is improved, be better equipped, in terms of personnel 
background, when they present themselves at your institu- 
tions. 

To implement better guidance work, State Supervisors for 
the next year are emphasizing evaluation At our last national 
conference the group organized the second revision of a pro- 
posed instrument for this purpose. In cooperation with the 
Cooperative Study of Secondary-School Standards and with 
various groups of State Supervisors, our Service has, as a result, 
published an instrument for evaluating guidance programs in 
secondary schools. During the next year this instrument will 
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undergo rigorous research designed to perfect it, If you are 
interested in this instrument and in the Manual, you may 
obtain single copies free of charge from our Office. 

Another significant development in the secondary-education 
field is the increase in the number of schools having counselors 
and guidance officers. From our studies we believe that nearly 
half of the students in the United States are enrolled in schools 
having a counselor. There are approximately 8,300 counselors 
located in nearly 4,000 different schools. However, only one 
school in six does have a counselor. It is quite obvious that 
guidance programs are common in the large city schools, where- 
as they are almost nonexistent in the small and rural high 
schools. This, I believe, has important implications for study 
by personnel workers in colleges which draw students in large 
numbers from the smaller communities and rural areas of the 
United States. The Supervisors of guidance services in several 
States have recognized the necessity of attacking the problem 
in rural areas. In some States, through the use of Federal 
funds, pilot programs in this type of school are under way. 
It is hoped that these pilot programs will not only stimulate 
the interest of the smaller schools in providing guidance ser- 
vices, but also identify methods by which these services can 
be provided despite staff and financial limitations. As the num- 
ber of high schools having counselors increases, the number of 
high schools with which you must deal will increase. Plans 
which are effective now for dealing with the counselor found 
in one out of six high schools may not be effective when most 
high schools attempt to establish liaison with your institution. 
Data available to us indicate clearly that more schools will 
have counselors. It behooves college personnel workers, there- 
fore, to make plans for effective articulation with these 
counselors. 

Undoubtedly you are familiar with the Joint Committee 
report on counselor preparation, which has been adequately 
described at another session of this convention. I should like, 
however, to describe a parallel effort of the Occupational In- 
formation and Guidance Service and the State Supervisors 
and Counselor Trainers cooperating with our Service. At the 
Eighth National Conference of these persons the major topic 
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was the consideration of current issues in the preparation of 
counselors. This conference on counselor preparation was not 
an isolated event. Rather, it was another link in a chain of 
events In 1945 one link was created when the Office of Educa- 
tion sponsored a conference of nearly 60 institutions on 
“Training on the Undergraduate and Graduate Levels in the 
Principles and Practices of Guidance Work in Secondary 
Schools.” Prior to this meeting counselor preparation had ap- 
peared, but only as one of a group of topics, on the agenda 
of six national conferences of State Supervisors. 

The Office of Education has given the problem of counselor 
preparation emphasis by appointing a specialist in the Occu- 
pational Information and Guidance Service who has been as- 
signed full-time responsibility in the area of training guidance 
personnel. Among his other duties, has been the continuance 
of the series of directories of “Offerings in Guidance Work 
in Colleges and Universities,” which have been published for 
some years each spring by our Service in cooperation with the 
Division of Higher Education in the Office of Education. The 
most recent issue, for the summer of 1949, has just come from 
the press. Single copies are available free of charge from the 
Office. 

The specialist for the training of guidance personnel also 
has the responsibility of aiding the States in their effective 
use of funds provided by the George-Barden Act, which made 
it possible for the States to use Federal money for reimburse- 
ment of counselor training. These new resources made a con- 
stantly recurring question more important: What should 
constitute a counselor training program? 

Beginning a rather ambitious study to help answer this 
question, in the spring of 1948 the Occupational Information 
and Guidance Service, in cooperation with the Division of 
Higher Education of the Office of Education, called together 
a group of State Supervisors and Counselor Trainers. Given the 
problem, “What should be the preparation of counselors?”, 
the group identified eight major subtopics and organized a 
skeleton committee from among its members to study each 
subtopic. These committees then recruited others to participate 
in the work. They met several times in the late spring and 
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summer, Each of the committees prepared a report and pre- 
sented it for consideration at the 8th National Conference 
of State Supervisors and Counselor Trainers. These reports 
were then revised in the light of discussion at the conference. 

This series of publications presents the revised reports. The 
titles arc: 

Dufies, Standards, and Qualifications for Counselors 

The Basic Course 

Occupational Information 

Analysis of the Individual 

Counseling: Techniques 

Supervised Practice in Guidance Services 

In-Service Preparation 

Administrative Relationships of the Guidance Program 

These reports, of which two have already been issued, should 
all be available by summer. Anyone interested may secure 
copies by applying to our Service. 

These four instances will serve to indicate a few specific 
ways in which our Service and your Association may work 
together: They relate to the interdependence of high-school 
and college personnel work; to the extension of guidance pro- 
grams in schools from which your students come; to 
publications and studies; and to the revision and extension 
of counselor preparation which will affect every level of coun- 
seling work. We enjoy a principal means of cooperation in 
our close relationship with the Division of Higher Education 
of our own Office of Education, and are eager to do our share 
in this field in any way which your Association may discover 
advantageous in the future. 



SIGNIFICANT DEVELOPMENTS AT THE NATIONAL 

LEVEL 


KENNETH LITTLE 

Director of Student Personnel Services, University of Wisconsin 

We are nearing the end of the fourth academic year since 
V-J day During this brief period our colleges and universities 
have faced the most challenging problems and opportunities 
of their history. Public interest in programs of advanced edu- 
cation has seldom been wider or deeper We are in a period 
of rapid changes. In my opinion, the changes have been gains 

The federal government’s experiment with a large-scale pro- 
gram of educational benefits to veterans has been a gain 
This program, I am confident, has paved the way to a con- 
tinuous program of federal scholarships to needy and worthy 
students — a long step toward extending and expanding educa- 
tional opportunity. 

The Report to the President by his Commission on Higher 
Education represents another gain Regardless of controversy 
upon some points, the total impact of the recommendations 
of this Commission upon policies and practices in higher edu- 
cation has been considerable. Certainly, the Report has brought 
to focus the crucial educational issues and decisions which face 
our colleges and the people who support them The document 
is, in itself, a powerful educational instrument. 

Still other wholesome influences upon higher education have 
resulted from the vast and far-flung educational program de- 
veloped by the armed services. Thousands of young men and 
women first tasted the fruits of advanced training and educa- 
tion while wearing a uniform. For many this opportunity was un- 
expected, but highly appreciated This spreading of educational 
opportunity has developed an appetite for advanced learning 
among wider segments of our society. 

The ventures of the armed services into educational experi- 
mentation have made fruitful contributions to our knowledge 
and practices of teaching and counselling. 
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Suffice it to say that higher education in this country has 
moved to a new level. It is not likely that we shall ever return 
to our prewar position. Time ever marches on, never hack! 

When the flood of veterans first struck our colleges and uni- 
versities, the need for collective action and widespread ex- 
change of experience and practice was urgent. In response 
to this need, the Department of Higher Education of the Na- 
tional Education Association organized in the spring of 1946 
a National Conference on the Education of Veterans, Two 
hundred selected leaders from American colleges and univer- 
sities attended. These leaders represented all branches of our 
profession, all types of accredited institutions, and all sections 
of the country. They met to exchange ideas and to formulate 
the programs of action needed to meet adequately the edu- 
cational needs of veterans. The conference was a working con- 
ference. There were few speeches, but much discussion. The 
index of participation among those who attended was very 
high. The objective was to get concentrated attention upon 
many problems by small groups of competent people who 
represented influential positions and important viewpoints. The 
Department of Higher Education thus hoped to offer itself 
as one agency by which all of the forces in higher education 
might speak as one upon a common problem. 

The success of this First National Conference led to a de- 
mand for its continuance as an annual event. By the spring 
of 1947 problems of educating veterans had become the prob- 
lems of higher education in general. The 1947 National 
Conference was larger and more successful than the first. Since 
that time, interest in these educational conferences has spread. 
After the 1948 national meeting, Regional Conferences were 
held in Oklahoma City and New York City. The Fourth Na- 
tional Conference on Higher Education concluded its sessions 
in this City just two weeks ago. Over seven hundred people 
participated. 

Problems directly related to student personnel have con- 
sistently made up a large share of the questions, problems 
and topics discussed. Many individuals in this meeting have 
participated in, and furnished leadership to, these discussions. 
The voice of the student personnel worker is being heard in 
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places where it counts. It is worthwhile for us personnel officials 
to meet, as we are in this convention, to share our woes and 
exult in our achievements. It is just as essential that we meet 
to discuss these same woes and achievements with those who 
have interests and responsibilities which are different from our 
own. If the contribution of the Department of Higher Educa- 
tion is at all unique, it is in providing an opportunity for 
leaders in student personnel to exert influence upon and to 
cultivate the understanding of those people in higher educa- 
tion whose cooperation they must have, and whose decisions 
ultimately determine the direction their programs will take 
In these conferences, Presidents, Business Officers, Academic 
Deans, faculty members, Registrars, Directors of Admissions, 
Student Personnel Officers, and representatives of State and 
Federal educational agencies share equal places in round table 
discussions. They speak as individuals, not as representatives 
of their institutions. I am certain that these discussions are 
increasing the general understanding and appreciation of the 
student personnel viewpoint, and stimulating the development 
of sound student personnel programs. 

To outline the specific problems discussed, conclusions 
reached, or actions taken would require greater time than 
I have been allowed. It would likewise assume greater patience 
than I think you care to exercise. I will conclude by saying 
that the Department of Higher Education represents an agency 
through which persons with differing responsibilities in colleges 
and universities may join with their colleagues in the discussion 
of issues and problems which require common understanding 
and cooperative action. It represents an agency through which 
institutions of higher education may, as one body, exert in- 
fluence upon national decisions which affect them all. It pro- 
vides an instrument by which student personnel workers may 
cultivate an enriched understanding of their purposes and pro- 
grams among a large and influential cross section of college 
faculties and administrative staffs. The Department of Higher 
Education is an effective organization rendering a unique ser- 
vice to higher education. I invite your attention to and partici- 
pation in its program. 



COOPERATIVE RESEARCH IN APTITUDE TEST 
DEVELOPMENT 


CHARLES E. ODELL 

Chid', Employment Counseling, Selective Placement and Testing Division, U. S, 

Employment Service 

Recently the Director of my Bureau, Robert C. Goodwin, 
had occasion to ask your President, Gilbert Wrenn, to com- 
ment on the question: “What, in your opinion, is the most 
significant step to be taken in the public employment service 
to build a better counseling program?'’ Your President’s an- 
swer was a challenging one, and I would like to quote him in 
part, because his response points up the general theme of the 
comments I would like to make to you today. Dr. Wrenn, 
after saying some nice things about USES occupational re- 
search and operations, made the following statement: 

The most significant steps to be taken in all public employ- 
ment work are in the area of the personal relations of the service 
to the somewhat neglected one-half of its clientele- - the pro- 
spective employees. , . , 

Research is needed, desperately needed, upon placement 
in terms of proved job satisfaction factors- upon better tests, 
to be sure, but perhaps different tests- upon counseling pro- 
cedures but procedures that aid the client rather than the 
counselor. 

Cooperative research is the only solution to these basic em- 
ployment needs. The USES has proved in its work with the 
General Aptitude Test Battery and its recent excellent ap- 
proach to the college placement of seniors that it can stimulate 
and develop cooperative research and service programs. This 
is probably its greatest contribution in the future, the stimula- 
tion of research by colleges and other agencies on problems 
that are Nation-wide in scope. To be effective in such a move- 
ment, the USES will have to prove to the colleges that its 
primary concern is in the solution of the basic problems faced, 
regardless of where or by whom the research is undertaken. 

Seldom is a speaker given so specific a delineation of what 
he is supposed to say as that outlined in Dr. Wrenn's above 
statement quoted from the Employment Security Review of 
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March, 1949. So it is my intention to rise to the bait and try 
to tell you what we are trying to do to stimulate cooperative 
research on worker analysis problems The USES and the 
Civil Service Commission are perhaps the only two agencies 
of government which are specifically engaged in test research 
in behalf of the civilian worker As you know, the Civil Service 
Commission’s program is primarily directed toward testing 
job proficiency or knowledge rather than aptitude or poten- 
tiality. 

Of course, the Army, Navy and Air Forces have large and 
significant test research programs, but these are directed pri- 
marily toward selection for training in military occupations. 
Therefore, when one looks for Federal governmental leader- 
ship in behalf of test research for civilian employment in pri- 
vate enterprise, one inevitably turns to the United States 
Employment Service. There was a time when we had a large 
and extensive central office and field research staff — at one 
time over 100 analysts were engaged in the development of 
oral trade questions, proficiency tests and specific aptitude 
tests for selection purposes. But, those days are gone — maybe 
forever. Today the total professional staff in the central office 
engaged in test research is seven people, including their capable 
Director, Dr. Beatrice J. Dvorak. 

When I was asked to take over a combined counseling and 
testing division, that was my inheritance in manpower. But 
there was a rich heritage in test batteries and information 
in techniques of analysis and ideas as to what was needed to 
be done and how it could best be done There was also the 
newly developed and introduced General Aptitude ‘Best Battery , 
the first differential aptitude test battery designed for broad- 
gauge use in counseling. 

My problem was to assist Dr. Dvorak in utilizing this heri- 
tage in tools and know-how to get maximum results in terms 
of both test research and the application of tests in local 
employment office operations. Our first decision was to con- 
centrate on the extension of the use of our tests throughout 
the nation, and we have achieved some measure of success. 
Today over 400 offices are using a wide selection of test bat- 
teries in daily operations. Last year over 215,000 were tested. 
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Our next decision was to decentralize test research to State 
agencies, because we recognized that we were no longer in a 
position to provide any volume of central office test research. 
Accordingly, in the past year, we have developed, and are now 
introducing, handbooks on the collection of test data and on 
its analysis. More than a dozen State agencies are actively 
engaged in test research and others are in the process of gearing 
themselves to undertake developmental work. 

Our third decision was to try to make maximum use of all 
potential sources of professional assistance From other agencies 
and organizations interested in test research. The most ob- 
vious and best potential source was the colleges and univer- 
sities. Here, however, we faced a major obstacle — we have 
little to offer except our tools, instruments, know-how and de- 
sire for cooperation. In other words, we have no money for 
subsidies such as those offered by the foundations, by industry, 
or by the military services. Now it is one thing to sell coopera- 
tive research or contracted research when you can pay for 
it and quite another to sell such projects on the basis of mutual 
interest and desire to extend the horizons of available knowl- 
edge and information on what makes for a successful worker 
on a job! 

But in spite of this grave limitation, the colleges and uni- 
versities have responded amazingly well, A few examples will 
indicate to you the possibilities of cooperative research: 

I, At the University of Utah, with the cooperation of Cal 
Taylor, the GATB was administered last year to close to i,ooo 
students in the final phases of their preparation, for purposes 
of developing norms for counseling toward Business Adminis- 
tration, Education, Pharmacy, Engineering, Social Science, 
Fine Arts, Pre-dental, Pre-medical, Law and Nursing. This 
year over 1,500 freshman students have been given the GATB 
and a study is now under way to compare aptitude test results 
with scores on interest, personality and achievement tests and 
biographical inventories, as well as to determine the effect; 
if any, of related training on aptitude test scores. 

1 . At the University of Minnesota, with Dr. Wrenn’s assis- 
tance, the GATB is being used with high-school students to 
derive sex, age, and grade norms, to determine growth in 
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various aptitudes between different age and grade levels, and 
to appraise such differences in test performance as may be 
associated with differences in sex, urban-rural environment 
and socio-economic status. 

3. At the University of Indiana, the GATB is being used 
experimentally to develop norms for the various major areas 
of specialization in Business Administration such as Account- 
ing, General Business, Management, Sales, Advertising, Re- 
tailing, Finance and Banking, Business Education, Secretarial 
Training, Insurance, Public Administration and Statistics. 

4. With the cooperation of Homer Rainey at Stephens Col- 
lege in Missouri, the GATB was administered to all final year 
students and tentative norms established on the various areas 
of specialization such as airline traffic service, clothing con- 
struction, merchandising, photography, radio and secretarial 
work. This year all entering students were tested and counseled 
on the basis of trial norms. 

These are but a few examples of what is going on with col- 
leges and universities. Other programs are under way or con- 
templated with Stanford, the University of Illinois, Tulane, 
Missouri, Ohio State and Duke University. But we are only 
scratching the surface and we know it. Dr. Wrenn is right — a 
great deal remains to be done. 

The point I want to drive home to you here today is that 
there is an agency of government which, though unable to 
subsidize your efforts, is interested and equipped to cooperate 
with you in extending knowledge of human characteristics 
that make for educational and vocational success and satis- 
faction. From such cooperation we gain, but so do you — your 
graduate students are provided with meaningful projects for 
dissertations and demonstrations of professional competence; 
your institutions are provided with meaningful data for use 
in educational and vocational counseling, and also with specific 
instruments in the form of the GATB and our specific test 
batteries for operating use in guidance and personnel programs. 

It is my long-range ambition to establish for civilian per- 
sonnel research in the USES, the same type of grass roots 
program that is now carried on through the Extension program 
of the Department of Agriculture in advancing scientific knowl- 
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edge about agricultural methods and production. This is not 
the dream of a bureaucrat hungry for centralized power and 
authority over the destinies of mankind, I recognize the limita- 
tions and disadvantages of a big, centralized research pro- 
gram, My desire is to see research develop at the grass roots 
level in the colleges and universities, the States and the locali- 
ties where the worker, the employer, and the counselor can 
see and understand the results, and thereby make better use 
of them. The role of the Federal agency in such a program 
would be that of adviser and coordinator; to digest, collate 
and exchange the best experiences from all over the nation 
and to guide the studies undertaken to assure a minimum 
of undesirable overlapping and duplication, In such a program, 
I would hope that funds would be available in signifi- 
cant amounts to subsidize local projects, I would also expect 
that our administrators and legislators would come at last 
to the realization that peace-time personnel research is a badly 
needed and long neglected phase of our national security pro- 
gram, as well as a major factor in our ability to mobilize and 
speedily allocate manpower in the event of a national 
emergency, 



FINANCIAL ASSISTANCE TO STUDENTS 

JOHN DALE RUSSELL 

Director, Division of Higher Education, Office of Education, Federal Security Agency 

The President’s Commission on Higher Education, in its 
Report issued in December, 1947, recommended a series of 
Federal appropriations to provide scholarship and fellowship 
assistance to well-qualified young people to enable them to 
attend institutions of higher education This recommendation 
has met widespread approval. In considering plans for putting 
it into effect we are confronted by a great many questions of 
policy and organization These must be decided before a law 
can be enacted and the machinery setup for its administration 
My remarks today will consist entirely of a listing of some of 
these issues. 

All of us who have anything to do with the drafting or criti- 
cizing of proposed legislation, or the setting up of plans for ad- 
ministration, heartily welcome the best advice and counsel we 
can obtain from every qualified source. It is for the purpose 
of obtaining such counsel that I am presenting to you today a 
list of some of the issues in the organization and administration 
of a Federal scholarship program. Within the limits of the 
time available to me this morning, I can present only a few of 
the more important issues. We shall be happy to have sugges- 
tions of additional questions, as well as your best thinking as to 
the solution of each of the problems. Here, then, are some of 
the issues : 

I. Do we have enough evidence of the need for a system of 
Federal grants for student aid purposes? Are the studies that 
have already been made, showing the large numbers of very 
capable high-school graduates who do not go on to college, 
sufficiently convincing with regard to the need for a program of 
student aid? 

a. What form should the aid program take: 

a. Grants to institutions for general support, so that they 
may reduce tuition and other fees? 
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b. Loans to students? 

c. Employment for students, similar to the former NYA 
program? 

d. Scholarship and fellowship grants? 

3. In considering the desirability of a Federally supported 
student aid program, do we need to take into account the 
probable demand for and supply of workers in the occupations 
which require college preparation? Is it safe to assume that, 
either (1) the increase in numbers of college-trained people to 
be brought about by a student aid program will not be suffi- 
cient to create an oversupply of persons qualified for the pro- 
fessions; or (a) that the student aid program will not actually 
increase the number of students in college, but will merely make 
certain that the most talented youth get a chance at higher 
education (presumably the colleges might hold their enroll- 
ments constant and merely replace some of the least-capable 
applicants by highly qualified scholarship holders); or (3) that 
guidance and counseling services can be relied upon as a means 
of preventing an over-supply? 

4. How many students should be aided? (Note that Presi- 
dent’s Commission on Higher Education suggested 20 per cent 
of the non-veteran students.) 

5. Should awards of scholarships be in terms of a specified . 
number or percentage of the total for each of certain designated 
fields of study or vocational objectives (e.g., Medicine, Den- 
tistry, Teaching, Social Work, Chemistry, Physics, Mathemat- 
ics, etc.), or should the recipient be completely free to choose 
his own major field of study? If fields are to be designated, who 
is to determine which ones are to be given preference and how 
many scholarships are to be awarded in each? 

6. Should grants be given without regard to the student’s 
own financial resources, or should there be a “means” test? 

7. If there is a "means 1 ' test, should the amount of the 
grant be scaled in accordance with the extent of the student’s 
own resources, or should only “paupers” be allowed to partic- 
ipate? Should the grants be scaled in accordance with the 
number of the student’s dependents? 

8. Should there be a single grant paid directly to the stu- 
dent, from which he pays his tuition, other fees, and living and 
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incidental expenses, or should the grant be divided so that one 
part is a reimbursement to the institution for the instructional 
services and the other part is a subsistence grant to the student 
(similar to the present arrangement in the educational program 
for veterans) ? 

9. If all, or any part of the scholarship grant, is to be related 
to the payments made to the institution for instructional 
service, should this amount be based on : (a) the stated charges 
of the institution for tuition and fees, up to a fixed nation-wide 
maximum; or (b) the actual cost to the institution of providing 
instruction in the curriculum followed by the student, also up 
to some fixed nation-wide maximum? 

10. If there are to be nation-wide maxima for scholarship 
grants, for tuition, or cost of instruction, or subsistence, should 
these amounts be written into the legislation or should they be 
left to be determined by administrative action? 

11. Should student aid funds be allotted to the States ad- 
cording to a formula written into the law? Or should the entire 
fund be administered centrally? Or should some of the funds 
(e.g., for undergraduate scholarships) be allotted to the States 
and 'some (e.g., for fellowships) administered centrally? Or 
should there be allotments direct to institutions, as was done 
with NYA funds for student aid? 

12,. If there are to be allotments to the States, is the formula 
suggested by the President’s Commission on Higher Educa- 
tion satisfactory? (Half of the funds allotted on basis of col- 
lege-age population, half on basis of annual number of high- 
school graduates.) 

13. Assuming that some or all of the funds will be allotted 
to the States, what should be the State organization for admin- 
istering the program? 

a Should there be a State Scholarship Commission? 

b. If there is a State Scholarship Commission, how should 
it be constituted and what should be the nature of 
its membership? 

c. What should be the extent and nature of the super 
vision exercised by the Federal Government over the 
program? 



404 educational and psychological measurement 


14. What agency should designate the institutions that are 
eligible to receive scholarship holders? 

15. Should a scholarship holder be permitted to attend any 
approved institution in any State, or should he be restricted 
to institutions in his own State? 

16. What should be the basis for selecting recipients of stu- 
dent aid? 

a. Would it be feasible to have nation-wide examina- 
tions, the results of which the States could use at 
their option? 

b. Should there be a requirement of selection strictly 
in accord with objective measures? 

c. What safeguards are necessary to protect the stu- 
dent aid program from becoming involved in political 
patronage? 

d. Can a system of selection be set up in such a way 
as to permit superior talents in wide variety to come 
to the top, e.g M music, art, social leadership, as 
well as verbal ability and mathematical skill? 

17. How can the interests of Negro students best be served 
in States where the races are required to be segregated for 
educational purposes? Will it be satisfactory to divide the State 
allotment on the basis of population ratio, and have Negroes 
compete only with Negroes, and whites only with whites, 
for scholarship awards? 

The foregoing list of issues presents a few of the more im- 
portant decisions that must be made if a Federal program of 
student aid is set up. The membership of the American College 
Personnel Association is an important source from which we 
shall hope to obtain advice and counsel at the appropriate 
time in drawing up plans for such a program. 



CONTRIBUTIONS OF THE VETERANS ADMINISTRA- 
TION’S ADVISEMENT AND GUIDANCE PROGRAM 
TO STUDENT PERSONNEL WORK 

IRA D, SCOTT 

Director, Advisement and Guidance Service for Vocational Rehabilitation and 
Education, Veterans Administration 

This is a subject in which the members of the staff of the 
Advisement and Guidance Service of the Veterans Adminis- 
tration have a very positive interest All of us have hoped that 
the Veterans Administration program for providing professional 
counseling services to veterans would so forcibly prove its 
great benefit to them that it would provide further impetus to 
the development of student personnel work and community 
counseling services. We feel, however, that our professional 
colleagues in the field of counseling and guidance who are not 
directly connected with the governmental agency designated 
by Congress to put into operation the program for the voca- 
tional rehabilitation of disabled veterans, and for the education 
and training of World War II veterans in general, are in a 
better position than we are to express with proper objectivity 
the contributions of the Veterans Administration counseling 
program to student personnel work. 

Since the sources of information used by the Veterans Ad- 
ministration in setting up the Advisement and Guidance pro- 
gram were largely the result of work previously done by persons 
engaged in student personnel work and closely related activities, 
it seems that a presentation of the Veterans Administration’s 
contribution to this field may properly be introduced by first 
indicating briefly some of the ways in which these earlier con- 
tributions were utilized in the development of our program. 
If more time were available it would be desirable to explain 
more fully the many ways in which the Veterans Administra- 
tion was influenced by the principles, procedures and techniques 
observed in the fields of psychology and counseling Obviously, 
it would have been impossible for the Veterans Administration 
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to have developed from the beginning and in toto an adequate 
counseling program durng the limited time in which millions 
of veterans had to he served. 

For example, in view of the lack of time to develop tests for 
our purposes, it was necessary for us, instead, to evaluate 
those already on the market and to choose the most suitable. 
The use of tests by Veterans Administration Guidance Centers 
probably stimulated a greater interest among personnel workers 
in exploring further the use of tests in professional counseling 
work. We were not given the authority to conduct original 
research, so wc combed and studied the literature on the ability 
requirements for occupations and prepared summary state- 
ments recommending procedures for our counselors to follow 
in order to improve their predictions of the individual's chances 
for success in the training programs prerequisite to various 
occupations. 

We tried in a short time to synthesize methods which had 
been accepted by leaders in the field into a definite procedure 
which was standardized so that the records of counseling ren- 
dered an individual in one part of the country could be used 
in other parts of the country upon a somewhat uniform basis 
of understanding. Since this had not been previously done, it 
may be regarded as one of the contributions of the Veterans 
Administration to any phase of personnel work that requires 
the use of counseling records. 

We have not only endeavored to find the best methods, tech- 
niques, and research data already developed by earlier workers, 
but we have been eclectic in the selection and application of the 
principles which had been developing in our profession. We 
have avoided adhering exclusively to the philosophy of any 
one school of thought. 

These are some of the ways in which we have utilized for our 
program many of the techniques, methods, research findings, 
and principles which had been developing for many years in the 
fields of personnel psychology, counseling, and guidance. But 
there was no ready-made design for us to follow. Counseling 
of stdults had never before been done on so large a scale. In our 
efforts to provide in an emergency situation for comprehensive 
counseling services on a systematic basis for a large section of 
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the adult population, we combed the field to find what was 
needed and we have also, we believe, made some contributions 
of our own by our methods of evaluating, selecting, and adapting 
the methods and techniques that were available to us. 

Turning now to the consideration of the more particular 
contributions of the VA program to student personnel work, 

I shall mention briefly a few which we believe to be of some 
significance 

First, we have established, in cooperation with the Civil 
Service Commission, qualifications for our professional per- 
sonnel such as Vocational Advisers, Personal Counselors, and 
Psychometrists. We arranged for Civil Service tests, designed 
to measure some of the required abilities, to be constructed 
and administered to candidates for these positions. While we 
may not have been successful in all cases in selecting and retain- 
ing only the best qualified persons, we recognized the need for 
the types of professional standards about which our personnel 
and psychological associations are now concerned. We have 
probably improved the status of counselors in general by set- 
ting up these standards and by insisting upon a higher level of 
remuneration than they were accustomed to receive in most 
educational institutions. As a result, more competent persons 
are being attracted to the field and qualified people who might 
have been tempted to leave will now remain. Furthermore, as 
a consequence of the Veterans Administration program there 
will be a reservoir of personnel, who have had a rich and val- 
uable experience i|n counseling and the skills necessary, to trans- 
fer to student personnel work in many cases with a minimum 
of additional training. 

The Veterans Administration counseling program provided 
the setting for showing with dramatic emphasis the need and 
value of counseling not only for students but also for adults in 
the community who are faced with problems of occupational 
or personal adjustment. As a result of experience in the Veter- 
ans Administration program many educational institutions 
which have had Veteran Administration Guidance Centers are 
already expanding their counseling services so as to serve non- 
veteran as well as veteran students and also all classes of people 
in the community. Dr, Mitchell Dreese has reported at last 



4<:--K educational and psychological measurement 

Monday’s meeting here of the American College Personnel 
Association the findings of a survey conducted by him for the 
American Council on Education, of 154 educational institutions 
which reported their plans for the continuance of the guidance 
centers after the Veterans Administration contracts expire. I 
believe that some slight repetition of the figures pertinent to my 
assigned topic is justifiable. Of the schools reporting, more than 
one-half (56 per cent) had not had a centrally organized counsel- 
ing service prior to the Veterans Administration contract. After 
experience with the Veterans Administration Guidance Cen- 
ters, he found that only one school reported that it considered 
that the value of the services had not been demonstrated. Four 
out of five institutions were definitely planning to continue the 
services and, of these, seven out of ten will make counseling 
available to clients in the community as well as to their own 
students. Slightly more than two-thirds of the institutions re- 
sponding checked as true a statement that the program has 
provided additional materials which will be of value after the 
Veterans Administration contract is no longer in effect, but 
only one- third expressed the belief that it has developed new 
techniques and procedures in testing and counseling. Forty 
per cent signified that it has resulted in an expanded budget 
for testing and counseling that will make it easier to maintain 
such services after Veterans Administration funds are not avail- 
able, and 57 per cent indicated belief that it had provided a 
laboratory useful in training student personnel workers. 

The Veterans Administration has also contributed towards 
putting student personnel work on a sounder basis than it had 
ever been before. The development had been very uneven prior 
to the war. It was operating in a few outstanding institutions 
but it was often fighting an uphill battle with administrators. 
In others, equally respected for academic offerings and enrolling 
thousands of students, professional personnel services were 
hardly recognized. Even in the most advanced schools, the im- 
petus and financial support provided by the governmental pro- 
gram has now established these services more securely and has 
had a favorable influence on students, Faculty and adminis- 
trative officials. In schools which had had no program earlier, 
it has provided the physical setting and facilities and the es- 
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sentials of test equipment, and occupational andother materials 
with which to carry on. 

At the N.E.A National Conference on Higher Education, 
held here in Chicago a year ago, it was brought out that it 
would probably have taken fifteen to twenty years for student 
personnel workers at many schools to have received enough 
funds in institutional budget allocation to have made such a 
demonstration of the value of counseling The official report 
of that conference contains the following statement- 

The emphasis given by the Veterans Administration coun- 
seling in the determination of educational and vocational ob- 
jectives, and the excellent results achieved through the guid- 
ance centers established at many schools have gone far toward 
removing the prejudice and scepticism of school administrators 
and faculty members in regard to programs of this sort So 
complete lias been the change from scepticism to acceptance 
that most schoolmen now regard the guidance center as a most 
effective ally to the academic program. 

Among the procedures which we introduced was one regard- 
ing which some of our academic colleagues were inclined to 
disagree with us at first, but which is being more widely ac- 
cepted now. I am referring to our policy of arnvng at a specific 
employment objective in a relatively short period of time 
Our Manual of Advisement and Guidance outlines a definite 
procedure for conducting the interview so that a veteran may 
be helped to come to a tentative decision at least as a basis 
for a plan of action. The plan may of course be changed at a 
later date if necessary in the light of future exploration, new 
information, and changed circumstances. Many advisers in 
colleges have come to appreciate the practical necessity of 
these methods, particularly with mature persons who cannot 
afford to be left in suspense for prolonged and indeterminate 
periods mulling over vague possibilities regarding their occupa- 
tional adjustment. 

One of the contributions which may not appear to be signifi- 
cant, but in actual practice has proven very important, is that 
of stimulating the systematic use of occupational information 
by developing methods of assembling and arranging it so that 
reference to the information in relation to any purpose is greatly 
facilitated and expedited. 
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In listing contributions we should mention our emphasis on 
considering the whole person, having careful regard to his 
personal and social problems as well as educational and voca- 
tional, and our use of specialists, called Personal Counselors, to 
whom veterans needing their services are referred. While'we 
were not the first to recognize the importance of the personal 
counseling function in vocational advisement, we were perhaps 
the first to provide this service on a separate basis by assigning 
it to a special adviser called “Personal Counselor.” Profes- 
sional counselors have realized the importance of diagnosis and 
treatment of personal problems not sufficiently serious to war- 
rant referral to psychiatrists. But many counselors in the past 
have not been well qualified for this type of counseling function 
and consequently some counseling and rehabilitation programs 
have failed to effect the occupational rehabilitation of their 
clients because they have given too little attention to the 
personal adjustment aspect of their cases. In our program, which 
required the recruitment of large numbers of counselors, it 
was evident that we could not expect to find that all persons 
otherwise qualified to do vocational counseling would also be 
capable of employing personal counseling techniques. We, there- 
fore, decided to set up the Personal Counselor as a specialist 
and to provide intensive training courses for persons who had 
the qualifications for such training. These specialists have been 
used by advisers and training officers to refer cases needing some 
professional asistance but not requiring referral to a medical 
specialist and also for cases needing special determination as 
to whether they should be referred to psychiatrists. 

We believe we have also demonstrated the feasibility of re- 
habilitating seriously disabled persons when emphasis is placed 
upon the remaining abilities, potentialities, and adaptive powers 
rather than upon disabilities, limitations, and handicaps. Em- 
phasis on the application of this principle has characterized 
our operations with all disabled veterans, so that it is but 
rarely that such veterans are considered incapable of being 
restored to employability. We have demonstrated to college 
Deans and Faculties that, to an extent not realized previously, 
severely disabled individuals may be counseled and trained 
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for suitable occupational and educational objectives with rea- 
sonable assurance of their being attained. 

It seems to me that we may conclude that the major contribu- 
tion of the Veterans Administration to student personnel work 
has been to accelerate the development of counseling and guid- 
ance services so that a much larger proportion of our student and 
adult population will profit from these services which had been 
available to a very small proportion of America’s student body 
prior to this program for veterans. The emergency, which re- 
quired the financial and administrative assistance of the Federal 
Government in rehabilitating veterans, has been in effect a 
catalyzing agent in stimulating and speeding the development 
of the professional counseling aspects of student personnel 
work. 



THK COLLEGE ADMINISTRATOR EVALUATES 
STUDENT PERSONNEL WORK 


VV1LJLARD VV. BIJVESSER 

Dean uf Student* am! As-ocUie Prafenwr of Education, Washington State College 

The purpose of this paper is to consider primarily the evalu- 
ation of student personnel work as a total concept and program. 

The title refers to the "college administrator.” Let me make 
clear that for the purpose of this paper, "student personnel 
administrators" are arbitrarily excluded, A college adminis- 
trator is hereby defined as a College or University President, 
Vice-President or Academic Dean who, whether budgets are 
contracted or expanded during the next few years, will have a 
good deal to say about the development of the student personnel 
program cm his campus. The student personnel workers will, of 
course, he affected, personally and professionally, by the nature 
and extent of this development, hut, most important of all, the 
college student will be affected. And the college student is our 
major concern. 

lajt us assume that this college administrator at the hypo- 
thetical University of X prides himself on being thorough and 
objective in his approach to and in his judgment of all phases 
of the educational program in his institution. There is a student 
personnel program on his campus, coordinated to a considerable 
extent, and one which has expanded with other parts of the 
institution during the post-war years. It appears to be moving 
along reasonably well but some important developmental plans 
for the entire institution are being projected for a ten-year period, 
and both classroom and extra-classroom programs are to be 
reviewed carefully. This administrator gave the green light to 
the expansion of the student personnel program following the 
war, and in general, he has been in accord with the objectives 
and services of the program. But it is necessary now to re- 
appraise the total institutional program and he raises these 
questions: 
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1 . What have student personnel programs been accomplish- 
ing throughout the country? What is the evidence? 

2. Just how essential and basic to the present and future 
program of the University of X is all of this student personnel 
work? Are its objectives being attained? What evidence do we 
have to date? 

3. What additional evidence do we need and how shall we 
go about getting it? 

Let me emphasize at this point that this college administrator 
has not been labeled as typical. We know that the typical college 
administrator functions infrequently as an educator, in the 
broad sense of that term. He asks rarely for experimental evi- 
dence, for the outcomes of the total program He is more likely 
to operate on a day-by-day basis, meeting pressures here, im- 
provising there, and giving critical attention to the student 
personnel services mainly when and if criticisms come from 
students, faculty or parents, or legislators, or if the inter- 
personal relationships among the student personnel staff are 
causing trouble. 

We student personnel workers usually lament the fact that 
most college administrators seem to operate in such fashion. 
We say that they are not educational statesmen and that we 
cannot interest them in the broad goals and outcomes of our 
work. Well, here we have a more or less ideal type of adminis- 
trator who is functioning also as an educator at the hypothetical 
University of X. Apparently we have convinced him over the 
years of the necessity of thinking of student personnel work 
as a total concept and program and of coordinating it along 
functional and administrative lines. Now he is raising questions 
with us accordingly. Can we produce? 

Let us look first of all at the evaluation picture from national 
and regional bases and then concentrate on the student person- 
nel program at the institution of this inquisitive administrator. 
What have student personnel programs been accomplishing 
throughout the country? What is the evidence? 

We find that the first national survey was undertaken by L 
B. Hopkins (6) in 192.5 under the sponsorship of the American 
Council on Education. Fourteen Colleges and Universities had 
agreed beforehand to participate in the study in order to learn 
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more about personnel work in higher education and how to 
make it more effective. Mr. Hopkins spent several days at each 
institution observing the work in process, interviewing the 
people concerned and examining whatever written data and 
records were available. He then rated each of 20 student person* 
nel services in these institutions on the basis of his own stand- 
ards. 

The national studies since that time appear to have been 
limited to questtonnnaire and checklist surveys by national 
associations with little or no attempt at evaluation. These 
studies were, of course, helpful in setting forth the nature and 
scope of student personnel work in higher education. 

During the early lyjo's Brumbaugh and Smith developed a 
point scale for evaluating personnel work in Colleges and Uni- 
versities of the North Central Association of Colleges and 
Secondary Schools (2). Weights were assigned to ten major 
areas of a student personnel program and specific performance 
items were analyzed in each of the areas. 

The North Central Association demonstrated considerable 
interest in student personnel work during the 1930’s. Gardner 
was asked til 1935 to investigate the extent to which provisions 
for student personnel services were associated with educational 
excellence in the colleges and universities of the Association. 
Fifty-seven institutions were included in the study and the entire 
field of student personnel work was divided into eleven different 
areas. The services in each area were analyzed and a series of 
score cards were derived in order to evaluate the total institu- 
tional program of student personnel service. Gardner weighted 
the various items in each area after consultation with experts 
in the field; a general score for the entire personnel program 
was then totaled. He also checked the findings of his system 
with the score card system developed by Brumbaugh and Smith 
and found close agreement. The general conclusion of the study 
was that an analysis of the provisions for student personnel 
service provided a valuable index of over-all institutional excel- 
lence (s). 

Western Personnel Institute has sponsored surveys of student 
personnel work in the eleven western states in recent years, 
About thirty western institutions have been cooperating 
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through WPI in promoting the development of student person- 
nel procedures and research materials. 

In WPI s 1948 study a combination questionnaire and rating 
sheet was constructed utilizing the descriptions of sixteen areas 
of student personnel service prepared by the Committee on 
Student Personnel Work of the American Council.on Education 
in their “first draft” revision of the 1937 brochure, The Student 
Personnel Point of View. The objectives of the study were to 
find out how many of these services were provided by the 
member institutions, how they rated the performance of these 
services, and how they rated the training and experience of the 
people performing these services. 

The thirty member institutions of WPI stated that they 
provided services in the sixteen personnel areas described by 
the Committee on Student Personnel Work of the ACE with 
the following exceptions : one did not provide service in the area 
of discipline, another in the area of religious counseling, three 
in marital counseling, three in foreign student counseling, and 
three did not provide an evaluation service which had been 
described by the ACE Committee as “A continuing program of 
evaluation of student personnel services and the entire edu- 
cational program to insure the achievements by students of the 
objectives for which this program is designed.” 

Generally speaking, the institutions rated themselves above 
average in both performance and the training of the student 
personnel workers concerned in the 16 personnel service areas. 
The area of evaluation was included among those in which the 
institutions indicated some dissatisfaction with performance. 
All but one institution making comments expressed a need for 
greater evaluation. But the WPI Committee making this study 
stressed the following among its conclusions: “We can’t rate 
and evaluate student personnel services adequately without 
some common understandings regarding detailed and specific 
objectives, functions, standards of performance and standards 
of training (4). 1 ” 

Those of you attending the business meeting of the ACPA 
two days ago heard the report of the Professional Standards 
and Training Committee, whose members had interviewed col- 

1 1948 Conference Report, Western Personnel Institute, Pasadena,. California- 
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lege administrators and student personnel workers in a sampling 
r*j' fifty collegiate institutions of various types. The college 
administrators were asked to make judgments regarding the. 
adequacy of the organizational setup for their student personnel 
programs, to prnpme the types of training necessary for student 
personnel workers in various areas, and to rank a series of 
personal characteristics submitted by the Committee in terms 
of imjwtance for student personnel workers. 

Most of you beard the report of the COP A Study Commission 
yesterday. 'Die pilot study to be conducted on secondary-school 
counselors in Maryland should pave the way for a real nation- 
wide study of the functions and qualifications of personnel 
workers at all educational levels. 

All of this is of interest to rmr college administrator but it is 
evident that national and regional studies have not to date and 
apparently will not in the near future give definitive answers 
to his question: What have student personnel programs been 
accomplishing throughout the country? Let us turn to the 
institutions themselves. What have they been doing on their 
own to appraise their student personnel programs? 

We find quite a few descriptive articles and research reports 
on various phases of the student personnel programs. The 
Committee on Research and Publications of the ACPA re- 
ported to us a few years ago that 230 papers were presented at 
the Conventions from 1914 t« 194° inclusive, dealing with the 
administration of personnel services, placement, clinical work, 
admissions and orientation, extra-curricular activities, financial 
aid, and vocational information (4). Over-all evaluations were 
not found. The Committee did express disappointment that only 
34 per cent of these papers involved the presentation of research 
material in any form. It is true that only a few names stand out 
as we think of people who have carried out experimental studies 
in one or more of the student personnel areas — for example, 
Williamson, E. S, Jones, Rogers, Bordin, Parley, Blackwell, 
Toven, and Ijcmzo Jones, 

However, we find the pickings even slimmer when we look 
for over-all analyses or evaluations made by institutions of their 
own programs. \V. H, Cowley directed a student personnel 
survey at Ohio State University in 1 931, which involved a 
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functional and structural analysis of services and agencies by 
means of interviews, time schedules and logical classifications 
Recommendations were then made for coordination and admin- 
istration, based upon a careful analysis of each function with 
respect to structure. Cowley wrote up the procedures followed 
in an article entitled, “A Technique for Making a Student 
Personnel Survey” (3), but there is little indication in the 
literature that other institutions followed suit. 

Williamson and Sarbm published a historical and descriptive 
analysis of the total student personnel program at the Uni- 
versity of Minnesota in 1940 (7). This analysis revealed organi- 
zational and functional strengths and weaknesses , recommenda- 
tions for improvements were made and the present structure 
and program of student personnel work in Minnesota stems in 
part from this study. 

Wrenn and Kamm published last year an interesting “first- 
step” procedure for evaluating a student personnel program (8). 
They pointed out that the evaluation of student personnel 
services is frequently neglected because there is doubt as to 
what specific services are involved in a student personnel pro- 
gram and because there has been a lack of adequate criteria 
against which the. effectiveness of a service may be judged The 
writers constructed a series of report forms by first selecting and 
defining the 14 functions making up a comprehensive student 
personnel program, then listing the specific services and pro- 
visions which they considered necessary to the adequate carry- 
ing out of each of the functions. The evaluator, in using these 
forms, combines the above sets of judgments and rates the de- 
gree to which each student personnel function is carried out 
in meeting the needs of students. An arbitrary weight is given 
to each of the 14 functions in terms of their assumed relative 
significance in the total program and a total score is derived 
regarding the extent of the entire program. 

The writers state that this method of evaluation has been 
used in some ia to 15 institutions, that the forms have proved 
workable but that the reliability has not been determined. 
They stress that the use of this method calls for judgments 
that can be adequately made only by a qualified personnel 
specialist or administrator. In their opinion “It is not primarily 
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an institutional self-rating form, although such a use is possible 
by a professional worker who can maintain strict objectivity 
to his own institution.” They conclude that their method of 
evaluation will isolate the specific services of a program, per- 
mitting an informed judgment as to their relative adequacy and 
pointing the way to more intensive evaluation of selected 
aspects of the program through appropriate research methods. 

it is evident from the review so far that there is little informa- 
tion we can muster to answer the college administrator who 
wants data on the outcomes of student personnel programs 
throughout the country. We do find, however, several interest- 
ing studies which attempt to get at the outcomes of the total 
educational program of an institution. The best known of these 
are the follow-up studies made by the University of Minnesota 
during 1939 and 1940 of graduates and non-graduates of the 
General College. These were significant explorations into the 
lives of alumni and ex-students in an attempt to identify the 
assumed outcomes of college education. Their findings brought 
about some changes along both curricular and student personnel 
lines and high-lighted the need for more intensive studies. 

Syracuse University is currently engaged in a Self-Survey 
under the direction of Dr. Robert Pace which includes student 
and faculty knowledge of, and use of, student personnel services 
as well as a follow-up study of the activities, opinions and 
experiences of a large sample of graduates.* The graduates are 
asked to indicate their activities in detail under the main 
headings of Politics, Civic Affairs, Religion, Literature, Music, 
Art, Science, Finances, Radio and Reading. Their opinions are 
secured along with a rating of the strength of these opinions in 
regard to points listed in the areas of Politics, Civic Relations, 
Government, The World, Philosophy, Literature, Music, Art, 
Science, Household, etc. The questionnaire also listed 18 goals 
which colleges might help students to achieve, such as: make 
a wise vocational choice; learn to think clearly; meet a problem 
and follow it to a right conclusion without guidance; develope 
social competence, etc. The graduates arc being asked to rate 
the importance of the particular knowledge, skill or understand- 

* Source: Correspondence with Dr. Robert Pace, Associate Director, Evaluation, 
and Psychological Service Center, Syracuse University, New York. 
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ing as a goal of college education, and then to indicate the 
degree to which their experience at Syracuse helped them in 
attaining this knowledge, skill or understanding. Students now 
attending Syracuse are being asked these same questions 

Princeton University started a five-year study in 1947 to 
find out what it is producing, what influences its production, 
and what it can do to improve its product— the student. In the 
words of President Dodds: 

The objective of the study is to examine as critically and 
systematically as possible through the use of modern techniques 
all aspects of residential university life, including both instruc- 
tional methods and programs and extra-curricular activities, 
for their effect on the student’s intellectual, moral and physical 
development . . . the truth is that we have not applied the tools 
of our trade to testing the results of our own educational efforts 
We have not applied our own methods to ourselves in spite of 
the fact that procedures have been developed m the fields of 
statistical analysis and the social studies which now are being 
extensively used to attack analagous problems in government, 
industry and commerce and which hold out similar promise 
for education. 8 

The Princeton Study will cover students from 1931 to the 
freshman class of 1947, totaling in number about 40,000. 

The results of the Syracuse and Princeton studies will be 
awaited with keen interest by all of us in the field of higher 
education. Meanwhile, our college administrator’s query about 
the outcomes of student personnel programs throughout the 
country will have to remain pretty largely unanswered. 

So let us go back to the campus of our University of X where, 
as you will recall, the administrator had raised additional ques- 
tions: Just how essential and basic to the present and future of 
the University of X is our student personnel program? Are its 
objectives being attained? What evidence do we have to date? 
What additional evidence do we need and how shall we go 
about it? These are tough-minded questions and we’ll have to 
proceed carefully. 

First, what is the framework within which we are working? 
We find that the Board of Regents and the Faculty established 
about ten years ago the following goals for the University to 
achieve with its students: 


a Milwaukee Journal , August 22, 1947 
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Affability to think honestly, clearly and constructively 
A facility in the oral and written use of English, and some 
familiarity with the treasures of literature 

An understanding of the meaning and methods of the main 
branches of learning 

Sufficient concentration in one or two fields of learning so 
that the student may be prepared more adequately for his life 
work 

An interest in the excellent management of his mind and 
body w that they may become concribvning factors in the fur- 
therance of the students’ life aims 

An appreciation of all peoples, past and present, thus de- 
veloping a cosmopolitan attitude of mind 

A social outlook and way of living that will lead to mutually 
satisfying and helpful relations with others 

An appreciation of beauty as expressed in nature and the arts 
The determination to use this knowledge for human welfare 
A personality developed around Christian principles 
and ideals. 

We find that an Advisory Committee on Student Personnel 
Work, set up just after the war and including representatives 
from the student body, teaching faculty and student personnel 
staff, worked out within its first two years of operation a 
comprehensive definition of student personnel work, a series 
of assumptions underlying this definition, and a number of 
specific objectives related to the phases of the program. 

Here is the definition: 

Student personnel work consists of those processes and func- 
tions undertaken by an educational institution which place em- 
phasis upon (i) the individual student and his intellectual, 
social, emotional and physical development, (a) the building of 
curricula, methods of instruction and extra classroom programs 
to achieve the preceding objective, (3) democratic procedures 
in working with students in order to help bring about their 
greatest possible self-realization, (4.) the performance of stu- 
dent personnel functions rather than emphasis upon specially 
designated individuals to perform them, (r ) 

Obviously, this is a broad definition which does not put a 
wall between student personnel work on the one hand and 
instruction on the other. It assumes that student personnel 
work should be done by all members of the instructional, 
administrative and student personnel staffs, differing only in 
extent, and in the respective roles of the persons involved; that 
it is carried on throughout the institution, differing from staff 
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member to staff member, but only in terms of role and degree, 
as well as in types of specialization. The basic assumptions 
worked out by the Advisory Committee are as follows: 

I . That individuals will inevitably have problems in adjusting 
to a complex society 

i That personality must be considered as a whole 

3. That there must be emphasis on prevention 

4. That personality and environment are inter-related 

5. That the individual has the capacity to take the major re- 
sponsibility for his learning and for the solution of his prob- 
lems 

6. That a common purpose must be defined and must operate 
in an interdependent democratic society 


The social-psychological foundations for these assumptions 
were outlined by the Committee, but we will not go into them 
at this time. Next, the Advisory Committee set forth objectives, 
based in large part upon the student personnel functions formu- 
lated by the American Council on Education in 1937 and in- 
corporated shortly thereafter in the charter of the American 
College Personnel Association They are : 


1. To encourage participation in student government to the 
mutual benefit of campus community and the individual. 

а. To assist students in planning their activity programs so 
that skills for effective leadership and cooperative group parti- 
cipation can be developed in line with individual needs. 

3. To work with all student organizations in the develop- 
ment of programs which will benefit the campus at large as well 
as meet the needs of individual members. 

4. To help interpret student interests and needs in relation 
to the classroom and extra-classroom policies and programs of 

the College. . , , • 

5. To enable worthy students to continue their education 
by making financial aids available through fellowships, scholar- 
ships, loans, and part-time employment. 

б. To make possible the attainment of personally successful 
and socially acceptable living in ar^ attractive and congenia 

environment. , , 

7 To provide a selected variety of experiences to sup- 
plement classroom learning; these experiences to be aimed to- 
ward developing social responsibilities ana good citizenship. 

8. To help students select and carry out a program ot gen- 
eral education which will serve as a basis for later specialized 


training. students t0 make w]se decisions in the selection 

of educational, vocational, and personally satisfying objectives. 
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io. To provide students with an opportunity for intensive 
self-exploration to remove personal obstacles to maximum use 
of their opportunities for growth during their college career. 

ti. To provide occupational information for students in re- 
lation to their preparation, aptitudes, and abilities. 

ta. To maintain contact with occupational patterns for 
placing graduates in industrial, business, and professional fields. 

13. To assist students from overseas and Americans 
planning to study abroad in solving their problems in order that 
their perh*d of foreign study may Ire ol maximum benefit to 
fhcmu*lvrs and to their hosrs in promoting international under- 
standing. 

54. To develop a student health program which will have 
educational and preventative aspects as well as clinical, by: 

a. Protecting the well from the sick. 

b. Detecting structural and functional defects and se- 
curing treatment for them. 

c. Discovering defective habits and attitudes and sup- 
plying appropriate information and advice for their 
correction. 

d. Teaching hygiene for present and future living 
through the scientific information and advice given 
the student regarding his health needs. 

Atl-Universiry objectives, a definition of student personnel 
work, assumptions and objectives of student personnel work — 
tliis is the framework we have to work with. What data do we 
have available at our hypothetical University with which to 
begin answering our administrator? 

1. A functional analysis of the student personnel program 
was completed three years ago. Some unnecessary duplication 
and overlapping was noted and minor administrative changes 
were effected, Also the Faculty and staff gained a clearer notion 
of just what functions were being carried on and what inter- 
relationships were necessary. 

1 . A study has just been completed regarding the predictive 
efficiency of the admissions program. It is now possible to 
predict scholastic success in the liberal arts college of this 
institution with fair efficiency, based upon high-school rank, 
a scholastic aptitude test and a reading comprehension test. 

3, The effectiveness of the how-to-study course had been 
measured just before the war by a control-group experiment. 
The results were not conclusive but there was some indication 
thatstudentsof average and better-than-average scholastic apti- 
tude profited from this instruction. 
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4. An experiment just completed involved 100 students who 
had received educational, vocational and personal adjustment 
counseling from the specialized staff in the Counseling Center, 
and who were paired on relevant characteristics with 100 stu- 
dents who did not receive specialized counseling. Various ad- 
justment criteria were set up and it appeared that 70 per cent 
of the group counseled had achieved better adjustment and had 
made better grades. 

5. A survey of the social and extra-curricular interests and 
needs of the students is just being started. Data will be gathered 
concerning the students use of leisure time, over- and under- 
participation in extra-curricular activities, etc. These data will 
be supplemented by individual case-studies. 

6 . A study has been made during each of the past three 
years of the use of the student personnel services, the extent 
and nature of referrals, etc. A healthy increase in use has been 
noted each year along with more referrals and a wider dis- 
tribution of these referrals from the various academic depart- 
ments 

7. Near the end of this year an opinionnaire covering all 
phases of the student personnel program will be given to repre- 
sentative samples of the student body and of the teaching 
faculty. Trained interviewers will use this opinionnaire and the 
results should be of real interest and value to the Advisory 
Committee and to the student personnel staff in gaining infor- 
mation on what people think of the personnel program. 

Well, so much for the studies already completed or planned 
Our administrator will be glad to have a summary of their data 
regarding our program, but little of it will be new to him He 
received brief reports of each study at the time of its completion, 
so our summary will in the main refresh his memory It is evi- 
dent that we cannot give adequate answers to his questions 
without further evaluation. 

What should be our next step? Certainly we should encourage 
additional studies of techniques, processes and results in all 
areas of our student personnel program — Admissions, Orienta- 
tion, Housing, Health, Faculty Counseling, Clinical Counseling, 
Financial Aids, Social and Extra-Curricular, Remedial Services, 
Discipline (civic control), Job Placement. We shall want to 
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relate to our student personnel services more of the findings of 
recent experimental studies in the fields of Anthropology, P S y. 
chology and Sociology, as will be stressed by Dr. Rohrer. He 
will also discuss with us some little-used research procedures 
worthy of more consideration by personnel workers. All of that 
is very important. 

But we are discussing in this paper the over-all evaluation ot 
a student personnel program and the concern of this adminis- 
trator regarding the outcomes of our whole program, and re- 
garding the degree of emphasis which should he given to the 
student personnel program in the crucial yearn ahead. Surely 
our projected evaluation should encompass the student as a 
whole, and we should attempt to evaluate the results of his col- 
lege experience, as a whole. 'Hi is means a total institutional study 
of the needs of the students coming to the. institution, and the eval- 
uation of the outcomes of the total educational experiences at the 
institution. 

We would insist that the concern of the University for the 
full development of the entire person, as evidenced by the state- 
ment of institutional objectives referred to earlier, be trans- 
lated into a thorough-going evaluation of the outcomes of the 
total University experience. We would ask our Advisory Com- 
mittee and our administrator to join with us in suggesting this 
full-scale evaluation to the appropriate Educational Policies 
Committee of the Faculty, We might bring to^ the latter com- 
mittee the conclusions reached by another institution in its fol- 
low-up study of former students. The study brought forth this 
discouraging picture of the adult life of its former students: 
Their goals were predominantly self-centered; they were not 
concerned with philosophy or religion; they had passive leisure- 
time pursuits; they became resigned in the face of complex 
family situations; they did not participate in local civic affairs; 
they failed to understand the influence of their jobs on their 
family happiness; they had inconsistent attitudes toward re- 
lated social problems; they were concerned about government 
but they failed to participate in political processes; their desire 
for reliable information was falsely satisfied by the reading of 
biased sources. All of this added up to disturbing apathy and 
complacency, to a disturbing failure to appreciate inter-rela- 
tionships among problems. 
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How do we know whether or not this picture fits those who 
have attended and those who have graduated from our institu- 
tion after they have been away from our institution for five 
years? Is there any difference between our graduates and non- 
graduates, our students and a comparable group of younger men 
and women who did not continue their education beyond high- 
school, our high-ranking and low-ranking students? Have we 
taught them to follow intellectual pursuits after leaving college, 
to think critically, and to build a social, cultural and intellectual 
life of a high order? Have we taught them and motivated them 
to the point where they will actively participate in the social, 
economic and political life of their communities and will see 
the essential relationships with other communities, with state, 
nation, and world? 

In brief, what do we accomplish with the human material 
which comes to us? What short-time and long-time effects do 
we seem to have upon a person’s life during his 1, 1 , 3, or 4 
years with us and, say, ten years after he has left us? 

There would be various phases of this total institutional eval- 
uation. Even before the goals appropriate to a particular insti- 
tution are clarified, there should be studies of the needs of its 
students and the needs of the society in which they live. The 
social and civic needs peculiar to the region, the employment 
needs of the region and their implications for curricular develop- 
ment, the personal, social and cultural needs of the high-school 
graduates who apply for admission, and implications of these 
needs for the full educational program of the institution — all 
merit careful study. As Eckert has pointed out, only then can 
the differences between the present status of students and out- 
comes considered appropriate for them individually and collec- 
tively be identified She adds that an “educated guess” about 
the future of these needs must precede evaluation, 

. . . because it is impossible for an educator to judge the worth 
of any discovered outcomes without being convinced that one 
type of growth is more desirable for a given growth of students 
than some other type might be. Every attempt made to find 
out what a school is accomplishing should help to refine these 
goals by furnishing clues to the characteristics that students 
ought to possess to achieve their purposes effectively. 4 

4 Eckert, Ruth C Outcome} of General Education. Minneapolis University of 
Minnesota Press, 1943, chapter 1, p. 15 



426 KDUCATIONAL ANti PSXOHOLOOICAL MEASUREMENT 

The evaluation must be fitted carefully to our particular in- 
stitution. Eckert stresses that “The development of an evalua- 
tion program in the light of the. goals and resources of each par- 
ticular institution most clearly distinguishes evaluation studies 
from many earlier surveys in which a common yardstick and 
common criteria of judgment were applied to great numbers of 
schools, despite fundamental differences In student potentialities 
and social opportunities.®” 

All possible evidences of growth or change must he gathered 
and carefully weighed- The exploration of changes in young 
people's thinking and living should be as extensive as the de- 
sired outcomes. This means varied kinds of evidence, great 
ingenuity in evolving an appropriate experimental design, the 
most refined analytical techniques, great skill in drawing rea- 
sonable generalizations from all of these evidences. Eckert 
cautions that “because appraisal studies emphasize inter-rela- 
tionships, because they try to view simultaneously and steadily 
a young person's successes both in the classroom and in out-of- 
school situations, they require thorough technical competence 
in the analysis of basic data. Even more, they demand what 
may be termed a statistical conscience in interpreting results."” 

This total institutional evaluation should be continuous, with 
related studies being carried on simultaneously. For example, 
we would propose a follow-up opinionnaire similar to that uti- 
lized in the current Syracuse Study in order to secure informa- 
tion from recent graduates and leavers, while at the same time 
we would be preparing to secure all possible data about next 
year's freshman class, including setting up an enlarged entrance 
testing program to secure measures of a student’s interests, 
aptitudes, personality characteristics, attitudes, etc. Using an 
adequate sample, we would attempt to measure change from 
year to year through frequent observations, interviews and 
measurements. We would follow this group for 5, 10 and 15 
years after graduation or school-leaving, attempting to evaluate 
desired outcomes, and plowing back our findings into our cur- 
riculum and student personnel services in order to adjust and 
improve constantly our total educational program. 
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Perhaps the resources of our institution will permit only a 
preliminary and exploratory study. The Evaluation Committee 
and others would stand to learn much from it, however, and the 
way would be open for more penetrating analyses. Above all, 
the instructors, student personnel workers, the administrators 
and the students concerned would undergo a rich and valuable 
experience in cooperative effort! There would be clarification of 
common goals; there would develop understanding and appre- 
ciation of each other’s contribution toward attaining these total 
institutional objectives. 

Some of you may wonder about this “ Shangri-la” University 
of X. It has been presented to you as an institution with real 
objectives, a fairly well-coordinated student personnel program, 
a Student-Faculty Advisory Committee which had agreed upon 
a comprehensive definition of student personnel work, basic as- 
sumptions and specific objectives. The institution has a top- 
level administrator who inquires about outcomes. Various re- 
searches in the student personnel field have already been com- 
pleted — more than most of us have in our own institutions. It 
sounds as if the student personnel workers in the University of 
X have a rather ideal situation They have, compared to most 
of us ! 

But, along with the rest of us, they do not know the outcomes 
of their total program. They have been given an unusual oppor- 
tunity to attempt to find some of the answers. We who are less 
fortunate may have to create such an opportunity. This kind of 
evaluation is hardly a magic formula It is only one of many 
things we need to do. It will not solve the many and various 
problems in the realm of student personnel. 

Dean Williamson pointed out in some recent correspondence 
that we have not yet arrived at an experimentally minded 
society or university which bases its structure and process upon 
objective evidence. It is an ideal toward which we should work. 
Meanwhile, we stand much to gain if we can stimulate our 
teaching colleagues and our administrators to give consideration 
to the formulation of objectives, to the definition of them in 
terms of human behavior, to the identification of the sources of 
evidence for observing such behavior, to the development of 
methods for securing the evidence, to the interpretation of the 
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results gathered in the light of our objectives and to the appli. 
cation of these results to the various parts of the educational 


program . 

The process will be slow and faulty. We cannot help but 
profit, however, by working cooperatively with our colleagues 
on these evaluation problems of mutual concern. And, above 
all, it is the student who will really profit as we apply our find- 
ings to the improvement of all phases of our educational 
program. 
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AN EVALUATION OF COLLEGE PERSONNEL WORK IN 
TERMS OF CURRENT RESEARCH ON 
INTERPERSONAL RELATIONSHIPS 


JOHN H ROHRER 
University of Oklahoma 1 

Introduction 

In planning this paper it was my intention to develop it along 
three lines: (i) To present an analysis of the societal functions 
which higher education served, and the role of the college per- 
sonnel worker in the performance of those functions. (2) To 
point out some little-used but valuable methodological research 
techniques which should aid the college personnel worker to ob- 
tain meaningful answers concerning the problems which con- 
front him in the field of teaching students skills in interpersonal 
relationships. (3) To review some representative research 
studies in the field of the social sciences that are pertinent to 
the problems of college personnel work. When I had completed 
the rough draft, I had just about enough material to last four 
times the length of time alotted me. In cutting it was necessary 
to present only the major conclusions of the first section without 
any documentation of the ways in which those conclusions were 
reached and, in addition, to make bare mention of the valuable 
research methodologies which are little used in personnel work. 
For those who may be interested, I plan to publish the first 
section in its detailed form. In the published report of this paper 
will be found references to a detailed consideration of the meth- 
odological studies mentioned. 

'The Societal Responsibilities of Higher Education and the 
Role of the College Personnel Worker in Meeting 
Those Responsibilities 

An evaluation of the societal functions to be served by insti- 
tutions of higher education, as revealed by an analysis of social 

'On leave for the 1948-49 school year and working at the Institute of Human 
Relations, Yale University, under a Social Science Research Council Fellowship award. 
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structure, role behaviors and adjustment difficulties unique to 
the population class, "'college graduates." leads to the following 
five conclusions: 

1 . Institutions of higher education have as their responsi- 
bility the development of those essential personal and interper- 
sonal skills and knowledges which will enable the student to 
successfully perform the role activities of a particular social 
status for which the institution purports to train him. Any 
failure to be continuously aware of this social frame of reference 
will lead to a neglect of a major area of training. 

2. In greater and greater proportions, the development of 
interpersonal skills and knowledges on the part of the student 
has become the responsibility of educational institutions. This 
is especially true for higher education because of the specialized 
categories for which they purport to train students. From the 
point of view of social functioning, institutions of higher educa- 
tion serve the basic function of providing training to those indi- 
viduals who aspire to a higher status standing; they are societal 
instruments to facilitate upward social mobility. 

3. Colleges and Universities, by and large, are failing to de- 
velop the essential interpersonal skills and knowledges on the 
part of the student which are essential for occupancy of the 
higher social category to which they aspire. We have no well- 
formulated, systematic training program to guarantee the stu- 
dent an opportunity to learn those interpersonal skills and 
knowledges essential and necessary for successful occupancy of 
the status for which we train him by way of personal skills and 
knowledges. This failure has, in part, been due to the myth that 
we in America have a classless society. 

4. Historically, the student personnel worker has assumed 
major responsibility for those organizations which the college 
community has evolved to provide some training in the develop- 
ment of interpersonal skills. In any evaluation of current college 
personnel work the chief negative criticism which can be made 
is to the effect that, by and large, personnel workers have not 
developed more effective training procedures for imparting to 
the student the interpersonal skills and knowledges essential for 
occupancy of the status for which the academic faculty prepares 
him by way of personal skills and knowledges. 

5. This failure of our educational institutions to develop 
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more efficient ways of imparting the essential interpersonal 
skills and knowledges, or to at least explicitly bring them out in 
the open for the student to discuss, has resulted in an actual 
perpetuation of many arbitrary and undesirable, but, neverthe- 
less, real social class differences. Our failure has resulted in a 
greater social and cultural lag which tends to interfere with the 
practices of truly democratic principles. Equally important is 
the fact that the personal conflicts which the college graduate 
experiences as a result of this lack of training causes the class, 
“college graduates,” to exhibit a greater number of symptoms 
of maladjustment than any other educational class in our popu- 
lation. 

Some Recent Research on Interpersonal Relations and its 
Implication for College Personnel Work 

One large and important area of research on human behavior 
is that one concerned with isolating the variables which deter- 
mine the development of personal or non-social skills. Adequate 
reviews of the voluminous literature concerned with these prob- 
lems are made yearly and there is no point to my “rehashing” 
them at this time. Suffice to say that we can do a real workman- 
like job with the problems of training in this area. We can 
measure an individual’s non-social skills and knowledges and we 
can make a fair estimate of his aptitude to learn those individual 
skills This is possible as a result of the rather elaborate develop- 
ment of basic knowledge in the field of tests and measurements 
which has in turn permitted the development of corresponding 
personnel practices represented in the college testing services. 
This ability to measure basic factors related to non-social skills 
has also permitted the development of elaborate job descrip- 
tions which define the minimal basic personal skills and abilities 
which are prerequisite for success on the job. This, in turn, has 
made possible a corresponding development of refined job-place- 
ment procedures by our college placement bureaus. We have a 
considerable body of basic knowledge concerning the variables 
which influence the acquisition of those personal skills which 
permit us to develop the corresponding college personnel prac- 
tice of providing remedial training programs in the fields of 
reading, speech, English and mathematics, to name a few. 

The body of basic scientific knowledge concerning the vari- 
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ables which control the development of interpersonal skills and 
knowledge has, by contrast with the non-social skills, been slow 
in developing. However, in recent years significant studies have 
been made which have not, as yet, received adequate attention 
in educational circles. These studies do not provide the solution 
for effective training in interpersonal skills and knowledges. 
They do, however, suggest the kinds of further research which 
will eventually permit us m develop interpersonal skills as effec- 
tively as we can now develop personal skills. I would like to 
consider briefly some of these studies and to point out some of 
the implications they have for college personnel work. 

The first field to he noted is that concerned with the develop- 
ment of measuring devices for assessing the interpersonal skills 
which an individual possesses. The most important develop- 
ment in this area has been the projective techniques. The pro- 
jective technique on which we have the most research data is 
the Rorschach “Rest, which has served as the prototype for the 
other tests which have been developed in the projective field. 
Perhaps the best discussion of the projective techniques is to be 
found in a recent book by Bell (t). In addition to the wide use 
which has been made of projective tests in the personal counsel- 
ing bureaus of colleges and universities, there have been some 
applications to the more general problems of college personnel 
work: for example, the work of Murphy at Sarah Lawrence (19); 
the work at the University of Chicago Medical School (18); my 
own work in the medical school at the University of Oklahoma 
(a6). The chief difficulty at present encountered with the pro- 
jective tests is that wc do not quite know what to do with the 
results, To demonstrate that the current procedures used to 
select freshman classes for Schools of Medicine result in a selec- 
tion of students, of which approximately 20 per cent are defi- 
nitely maladjusted, is one thing. To provide effective preventive 
training procedures in the pre-medical training program is quite 
another, There is, however, some basic research work which 
points the way in which these preventive and remedial training 
programs might develop, which brings us to the second research 
field which is concerned with attempts to identify the social 
variables which control the development of interpersonal skills. 

Of major importance is the area of research represented by 
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the classic studies of Sherif (23, 24). Sherif experimentally dem- 
onstrated that the activities of an individual are always a re- 
flection of, and are influenced by, the social situation in which 
they occur. Secondly, his studies identify some of the basic 
variables which control the development of interpersonal ways 
of acting, and he has experimentally demonstrated the way in 
which some of these skills can be taught These studies, since 
they experimentally identify some of the variables which control 
the development of interpersonal skills, should receive the con- 
sidered attention of every personnel worker. 

A second area is that represented by the work ofWarner and 
his associates (28) which present data demonstrating conclu- 
sively that in our modern American communities there exist 
distinctive class and status structures, that each class and status 
has distinctive standards of acceptable behaviors, and that in 
moving from one class to another these different standards of 
behavior must result in much personal conflict. Perhaps an even 
more important contribution of Warner’s Yankee City Series is 
the demonstration that ethnographic field methods can be suc- 
cessfully used, in complex societies, to isolate and describe those 
important cultural variables which determine the development 
of role behaviors acceptable to a given status. The implication 
for higher education of this work is clear. As social institutions 
designed to provide the student with the necessary skills to 
successfully engage in upward class mobility, it is essential that 
we know, first, what the role behaviors are that the student 
must learn, and second, how we can devise methods of teaching 
them. The Yankee City Series is a big step forward towards 
making both of these problems capable of solution. 

A third area is that represented by the pioneering work of a 
small group of anthropologists, psychiatrists and psychologists 
on the relationship between personality development and social 
structure. Of importance here is the work of Ralph Linton (16), 
H S. Sullivan (27), Kardiner (11), Fromm (7), Gillin (8), Kal- 
degg (10), and DuBois (4). This work demonstrates conclu- 
sively that the individual’s personality structure reflects the 
specific culture to which he has been exposed and that person- 
ality configurations vary as a function of the existing social 
structure. This has at least one important implication for edu- 
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eatinnal and personnel practices. We have in the United States 
cultures, not a culture. It fallows, therefore, that different col- 
leges and universities, in order m achieve a common product 
must engage in varying educational procedures dictated by the 
cultural backgrounds of their students. A good methodology for 
developing desirable interpersonal skills on the part of the stu- 
dents, say at the University of Maine, may he of no value, or 
indeed a handicap, in attempting to achieve the same outcome 
at the University of Oklahoma. Kadi institution must develop 
its own program of social training in terms of the cultural 
background of its students. This conclusion strikes directly 
against one of the most hallowed of all personnel procedures, 
that of imitating in /ala the procedures of a high prestige per- 
sonnel organization located in some distant place, and justifying 
the whole procedure not in terms of local needs but in terms of 
the excellence rtf the program at the distant institution. Pro- 
cedural imitation, as such, has no justification in terms of what 
we now know concerning regional cultural differences. 

A fourth important area is that represented by the Benning- 
ton College study (Jo). This study demonstrated that attitudes, 
opinions, ami ways of interpersonal participation can be modi- 
fied by the interpersonal environment found in the College and 
that in large part this modification occurs in interpersonal ac- 
tivities engaged in external to the class room. The implication of 
this study for college personnel work is dear. The college per- 
sonnel worker in his sphere of activities does have the means for 
developing successful training programs in interpersonal rela- 
tions. His problem is simply one of research to isolate the vari- 
ables which are dominant in his own particular institution. In 
this connection it should be noted that all college personnel re- 
search organizations have available the makings of an elaborate 
personnel research organization at their own institution, 
namely, the members of their own academic teaching staff. In 
line with an earlier discussion at this meeting, one of the easiest 
ways in which to obtain eod^rarion from the teaching staff at 
your institution is to provide them with a clear-cut research 
problem in their own field of research interest and ask their aid 
in its solution. Frankly, we of the academic staff are 1 ‘suckers” for 
that kind of “bait" and, seriously, much valuable research data 
and goodwill would result from such cooperation. 
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These major research trends for studying the variables con- 
trolling the development of interpersonal skills are actually 
concerned with the positive training of students in order to 
bring about an adequate mastery of essential interpersonal 
skills. There is one important aspect of training in interpersonal 
skills and knowledges left to discuss, namely, the field of reme- 
dial training. 

The development of remedial procedures for training a stu- 
dent in interpersonal skills and knowledges is closely associated 
with the work of Freud. One of Freud’s really great contribu- 
tions to the treatment of the mentally ill was his recognition of 
the fact that most personal maladjustments develop from the 
conflicts arising in interpersonal relations, particularly the pat- 
terns of interpersonal relationships learned in the basic socio- 
cultural group, the nuclear famdy. It was a comparatively easy 
step to adapt Freudian retraining procedures to the problem of 
the remedial training of interpersonal skills of college students. 
The emotional zeal and fervor with which the adaptations have 
been made by some college personnel people is evidence of the 
really great need those workers felt for some technique which 
would aid them with their retraining problems. One of the cur- 
rent popular but restricted and specialized adaptations of psy- 
choanalytic procedure is called “non-directive counseling.” 
Rogers (ai) in 194a published a manual summarizing a set of 
procedures which are derivations of some aspects of psycho- 
analytic techniques. In that manual he very carefully pointed 
out the limitations to the use of the technique in remedial train- 
mg procedures. These limitations are such that the method 
could be strictly applied to only about 10 pet cent of the general 
population and possibly 15 per cent of the college population 
Despite Roger’s explicitly stated limitations there has occurred 
an almost hysterical generalization of those procedures to the 
point where some enthusiastic apostles of the non-directive 
technique offer this admittedly limited technique as a cure of 
all the ills of society. Even more unfortunate is the fact that 
hardly any basic research has been done to determine what the 
application of the technique actually does to the individual, or 
what validity the technique has for retraining the person in 
interpersonal skills. 

What little evaluative research work has been done points to. 
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the restricting limitations which the method has. Take, for 
example, the generally held belief of the Rogerian apostles that: 

If given an unstructured situation in which one person talks to 
a second person concerning a personally frustrating problem 
there will result, on the part of the talker, an experiencing of 
emotional release or catharsis which, in turn, “provides for 
growth.” “Growth" is the desired outcome. Translating the 
clique jargon into traditional psychological terms, it is held 
that verbalisation about a frustrating problem will automati- 
cally result in the elimination of conflicting emotional factors 
which will in turn provide for improved performance in inter- 
personal situations. Yet, a recent experimental study (tt) dem- 
onstrated conclusively that talk, in a Rogerian unstructured 
situation, about a personal problem served only to frustrate the 
individual more, which was reflected in a building up of an emo- 
tional state and a consequent lowering of the performance of the 
individual. Moreover, this study demonstrated that “emotional 
release" can occur only when the client ceases to be frustrated. 
The cessation of frustration may be due to problem solution or 
it may be brought about when the client temporarily escapes 
from talking about the frustrating problem: catharsis may occur 
without any problem solution. If nothing else, this study dem- 
onstrates the great urgent need for objective critical experi- 
mentation on the whole problem of the therapeutic role of 
emotional release and of the variables which govern its oc- 
currence. 

Much more clarification is also needed on what is meant by 
the stated desired end-product of counseling, "growth." Rogers 
and his students write about it as if growth takes place through 
the process of “insight.’’ But insight is not a process, it is a phe- 
nomenon; no one has ever demonstrated a "process of insight.” 
By inference "growth" must refer to psychological growth or 
learning, yet Rogers’ manual contains not one single reference 
to the experimental studies on learning which have been accu- 
mulating for SS years. Since therapy is synonymous with learn- 
ing, it would seem reasonable that a consideration of the experi- 
mentally demonstrated facta concerning learning would aid 
greatly in the formulation of a methodology of retraining. 

The whole problem of the validity of the claimed results of 
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non-directive counseling is also in need of more careful experi- 
mental study. In a follow-up study I made of $o employees at 
the Hawthorne plant, all of whom had been in counseling rela- 
tionships with the counseling department for a year or more, I 
found 33 °f them did show a permanent desirable change in 
their behavior as evidenced by a decrease in the number of per- 
sonal problem references, etc I also found that 2.6 of those 33 
exhibited that change only after they had visited the Placement 
or Social Service Departments (which at Hawthorne have “di- 
rective counseling” functions). These departments brought 
about a re-structuring of the 26 employees’ home or working 
interpersonal environment. In view of such data one can hardly 
claim that the desired change of all 33 was attributable solely to 
non-directive counseling. 

In a recent monograph, Muench (17) purports to make an 
evaluation of non-directive therapy. The evaluation is made in 
terms of various test scores obtained before and after therapy. 
The size of the sample reported on is 12. Certain statistical pro- 
cedures were applied to the test results which are interpreted as 
showing that a desirable change occurred in the basic person- 
ality structures of this group which is attributable to non-direc- 
tive psychotherapy. Of the tests used by Muench greatest em- 
phasis is placed, perhaps rightly, on the Rorschach results. In 
grouping his data for analysis he assumed that during the 
process of therapy (i.e., the process of learning), evidences of 
“no-change” were insignificant and hence should not be con- 
sidered in the statistical analysis. For example, he statistically 
evaluated the differences between the number of new Rorschach 
responses following therapy which were deemed desirable and 
the number of new Rorschach responses which were deemed 
undesirable following therapy. His conclusions were based on 
this type of analysis. This is analogous to assuming that in 
teaching the multiplication tables one has a successful method 
if, following training, the number of new correct answers given 
by students are greater than the number of additional new 
wrong answers given. The fact that a»majority of the students 
continue to give the same answers at the end of training as 
they did at the beginning would, by Muench’s reasoning, be 
ruled out as of no significance. If one makes the assumption, 
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common to experimental studies of learning, that a failure 
to show a changed pattern of behavior or to show a change in the 
opposite direction from the onedesired is evidence of the failure 
of the training procedure, then one is justified in Statistically 
comparing the improvement data with the “remainder" data, 
When such a grouping is made of Muench’s Rorschach data 
(17, p. 154) there results two groups, an "improvement” and a 
"no change plus decrement.” Statistical analysis of those results 
shows that the Rorschach changes following therapy are just 
about what would be expected to occur due to chance, al- 
though in the "Personal Adjustment” factor there is a sug- 
gestion that personal adjustment was worse after counseling 
(differencestatisticallysignificantat theao per cent level of con- 
fidence). The number of cases involved in the Muervch study 
was so small that one cannot attach too much significance to 
his results. His general design was laudable. With less biased 
treatment of the data it is possible that this design will pro- 
vide much needed validity data concerning the technique. 

Finally, there is a little-read, but important, monograph by 
Mary Shirley (25} which represents one of the most exacting 
validity studies of release therapy which has yet been reported, 
ft reports a follow-up study which was made of 55 former clients 
of the Smith College Child Guidance Bureau, The follow-up was 
made from four to ten years following the closing of the clinic 
case record. Counseling had been given both children and par- 
ents. To quote the results found in the follow-up, "more than 
one-half of those children and mothers who received the type 
of guidance called 'advice and suggestion’ eventually overcame 
their difficulties. . . . only a tenth of the children and mothers 
who received 'insight' therapy at the clinic finally outgrew their 
difficulties," 

I have gone into the detailed consideration of the problem of 
the relative validity of “non-directive” counseling as a tech- 
nique for developing interpersonal skills because I feel that not 
enough attention has been given to the whole important prob- 
lem. Too much of the type of thinking represented by the 
"either-or" dichotomy has gone into the writings of its pro- 
moters. It is time that those personal counselors re-structured 
their field and came to appreciate that release therapy is just 
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one of the many useful tools available for developing skills in 
interpersonal relations. A recent series of articles by Finesinger 
(5) attempts to demonstrate the way in which release therapy 
fits into the whole problem of remedial training of personality 
factors. “Non-directive” counseling, as one specific demonstra- 
tion of a technique of release therapy, may demonstrate itself 
to be as useful a tool for developing certain deficient skills in 
habits of interpersonal relation as has Grace Fernald’s kines- 
thetic reading method in the remedial training of certain de- 
ficient reading skills. One fact concerning its value is abundantly 
clear. At best, it is one of a host of useful tools available 
for remedial training of interpersonal skills; it is not the tool. 

Finally, I wish to point out some methodological research 
procedures which are little used in college personnel work but 
which are worthy of further consideration by college personnel 
workers. 

It is impossible to discuss methodology without immediately 
coming face to face with the problem of valid criteria. The val- 
idity of a given criterion is directly given by the accuracy with 
which one can predict a future specific event, (i.e , “event a”), 
from a present specific event, (i.e., “event i”). A point which 
greatly simplifies the problem of valid criteria is that the empiri- 
cal occurrence of event 2 is the only wholly valid criterion measure 
which exists. To the extent that we use as a criterion some meas- 
ure of event 1, to that extent we have a valid criterion. To the 
extent that we use some characteristic of event 1 which stands 
in a known empirical relationship to event 1, to that extent 
we are using valid criteria. These facts concerning the validity 
of criteria have important methodological implications. First, 
in order to make a statement concerning validity, one must be 
able to identify the two specific events under question. Second, 
these events must be quantifiable on a cardinal or ordinal scale. 
Third, we must know the empirical relationship which exists 
between events 1 and a. To the extent that we attempt to 
make statements of relationship between concepts of high-level 
abstractions and specific events, to that extent we lower the 
validity of our stated relationship. This follows from the fact 
that the greater the degree of abstraction of the concept, the 
greater the probable error of the statement of relationship be- 
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tween the concept itself and the specific event for which it 
stands. Thus, statements concerning" the relationship between 
childhood frustrations and success in life” arc meaningless and 
the statement of relationship can have no validity since the ab- 
straction “success in life" can mean almost any subsequent 
event. To discuss further the concept of validity would carry 
me far afield from my assigned topic. I hope that this brief dis- 
cussion of the concept of validity will point to the importance 
of avoiding high-level abstractions and also point to the neces- 
sity for picking empirical observables when choosing criterion 
measures. 

The first methodological procedures to be mentioned are 
those of R, A. Fisher and his students (6). His methods have 
been elaborated from the problems involved in more precisely 
estimating the magnitude of error introduced by random sam- 
pling, into an experimental situation. The actual statistical pro- 
cedures utilized arc called analysis of variance and covariance. 
In connection with his statistical work Fisher and his students 
have given detailed consideration to the types of experimental 
designs to which these methods of statistical analysis are best 
fitted Ilia designs, which are ideally fitted to many problems of 
research in college personnel work, have not achieved the popu- 
lar recognition which they deserve. Since Fisher’s methods per- 
mit one to validly estimate the degree of interaction occurring 
between two or more measurable variables, they are especially 
adaptable to research work in which several measurable vari- 
ables are interacting simultaneously. Lindquist has pioneered 
the use of these methods in the field of education and his text 
(14) is perhaps one of the best introductory presentations of the 
application of these methods to the problems of education. 

The second methodological procedure is that involved in the 
ex post facto experiment. This methodological procedure consists 
essentially of a refinement and elaboration of aspects of the 
genetic method which has been used in psychology with varying 
degrees of crudeness since the time of G. Stanley Hall. The 
elaboration of the procedure into a very useful research method 
is attributable to a group of sociologists led by Professor F. S, 
Chapin of Minnesota (3). Perhaps the best statement of this 
method is to be found in a small volume by E. Greenwood (9). 



CURRENT RESEARCH ON INTERPERSONAL RELATIONSHIPS 44I 


The nature of the ex post facto experimental design can perhaps 
be made clear by contrasting it with the classic single-variable 
experimental design in which we very carefully control and reg- 
ulate the independent variable, (1 e , the stimulus variables) 
acting on an individual, and then observe the influence of that 
variable on the occurrence of event two, the response Con- 
versely, in the ex post facto design we exert our control through 
selection of the stimulus variable after it has operated and 
thereby reconstruct what might have been a classical experi- 
mental situation. The advantages of such a research design for 
personnel workers is very great since they commonly must 
start with the existing uncontrolled social and non-social en- 
vironment of the students (1 e., the “environmental” variables) 
and are then asked to make meaningful explanatory statements 
concerning the resulting behavior. 

The third methodological research procedure consists of the 
ethnological field methods which have been devised by anthro- 
pologists for studying culture. Briefly, their research method 
consists of actual partial initiation of the researcher into the role 
behaviors required by the statuses existing in a social group. 
The initiation takes place through the aid of an informant who 
is thoroughly familiar with the group. In practice, it is as if a 
Dean of Students was to go to a campus where he was not 
known, enroll in the college and then obtain an outstanding 
senior to guide and explain to him the proper behaviors to 
achieve the status of “outstanding senior.” This would include 
an explanation of why it is important to efficiently use the files 
of past examinations; why it is necessary to work furiously to 
get admitted to an office in a social group, and, when once 
achieved, why it is doubly important to furiously work for an 
office in another social group; an explanation of the intricacies 
of the rating -dating complex, etc. In addition to the instructions 
given by the informant, this information would be supple- 
mented by the visiting dean’s own observations and his less in- 
tensive interviewing of other members of the society. He would 
continue to gather information on the culture until the number 
of novel, unexplained situations encountered per week or month 
stabilized around zero. This point might be represented graph- 
ically by that point on a negative growth curve at which the 
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number of novel answers is constant and hence the curve be- 
comes asyntotic to the base line around zero. 

The chief advantage of the anthropological field methods for 
studying our college culture lies in the fact that, if properly 
used, they permit one to obtain a factual description of what 
actually are the shared patterns of interrelationships operating 
in the social group. This empirical type of descriptive data is, 
and must always he, the starting point in formulating a mean- 
ingful statement of the relationships existing between variables. 
The chief criticisms which have been leveled at the procedures 
of the field anthropologist are; (t) their sampling techniques are 
wholly inadequate in that they are biased and result in distorted 
pictures; (a) they fail to present their data in terms of the indi- 
vidual but instead report their data in terms of categories or 
statuses ; and, ( 3 ) that the methods arc valid for studying primi- 
tive etdtures hut arc* wholly inadequate for dealing with complex 
cultures such as ours. The firsr and second criticisms have been 
made by naive individuals who arc unaware of the fact that 
there arc several equally valid levels at which relationships can 
he described. One docs not have to describe interpersonal rela- 
tionships in terms of the individual; they may be described in 
terms of categories or statuses and hence indirectly may be 
related to individuals just as w*c, in psychology, describe the 
independent variables controlling the rate of acquisition of a 
motor skill without any direct reference to the muscle segments 
involved. The common-sense idea of the anthropologist in the 
field, to consider his data complete when, with continued infor- 
mation-gathering activity, his basic pattern of information is 
not altered, is a sound procedural practice as has been demon- 
strated in a far more precise manner by the statistical formula 
for determining tire size of a sample within given limits of sam- 
pling error a formula that has proven valuable in phases of 
market research (a), public opinion polling (15), and studying 
sex behavior of the human male (ia). By and large it appears 
that the field methods of the anthropologist have much to 
commend them to the personnel worker as a technique for ob- 
taining descriptive information about interpersonal relation- 
ships. It is more than an interview technique since independent 
observations are constantly being made by the ethnographer 
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and added to his body of knowledge concerning the culture be- 
ing dealt with. The successful use of the method demands a 
rigorous application of the basic rules of scientific description 
just as does any other scientific methodology. The first volume 
of the Yankee City Series (28) and Kluckhohn’s (13) recent 
monograph are perhaps the best descriptive sources on this 
technique. 

In closing, higher education in general and college personnel 
workers in particular are going to have to develop more effective 
training programs for the development of interpersonal skills. 
To do this we must have, first of all, a body of basic knowledge 
concerning the variables controlling the development of inter- 
personal skills and knowledges. The social structure of the col- 
lege provides an excellent laboratory. The college personnel and 
academic teaching staff working together as a research team can 
do the research. By such efforts, we may some day be able to 
write a job description of interpersonal skills and knowledges 
which is as complete a guide for training as are our present job 
descriptions of non-social skills and knowledges. 
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A LIMITED SURVEY OF PROFESSIONAL STAND- 
ARDS AND TRAINING OF COLLEGE 
PERSONNEL WORKERS 

CLIFFORD G. HOUSTON' 

Dean of Students, University of Colorado 

During the meetings of the American College Personnel As- 
sociation a year ago, members heard a report by Gordon Ander- 
son in which he made certain recommendations for the Profes- 
sional Standards and Training Committee. A common core and 
special minimum training requirements for five types of college 
personnel work were presented. 

The Professional Standards and Training Committee foi the 
year 1948-49 studied this report and decided to investigate the 
qualifications of a sampling of college personnel workers. In 
making this decision the Chairman was advised by members of 
the C.G.P.A. Study Commission and the Academic Council of 
the Western Personnel Institute. 

The Study Commission of the C.G.P.A. has been charged 
with the responsibility of studying professional qualifications. 
By agreement with the Commission it was determined that the 
ACPA Committee might work on one phase of the problem this 
year, as a pilot study. 

The ACPA Committee decided to explore, with the limited 
funds available, the following aspects of the work of these col- 
lege personnel officers — Coordinators of Student Personnel 
Programs, Deans of Women and Men, Counselors, Directors of 
Admissions, and Directors of Student Activities: 

1. Qualifications 

a. College degrees earned and college degrees which these 
individuals and their administrators consider “ideal.” 

b. Undergraduate major and “ideal” major. 

c. Graduate major and “ideal.” 

d. Major work experience prior to present position 

e. Special courses deemed “ideal.” 

1 Chairman, Professional Standards and Training Committee, Amencan College 
Personnel Association. 
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a, Dciirahility uf internship 

3. Desirability of certain type* of work experience 

4. Pervonal rharactensties deemed most important 

5. Deficiencies in training and qualifications 
ft. ljength rtf service 

7. Reason for entering the personnel field 
ft. Organi/af inn tif personnel progrants 


Investigation of duties performed by these, officials indicated 
a very wide range and great variations in time devoted to them. 
Study of extra-curricular activities in which they engaged while 
they were college students was made, hut no significant data 
were secure*!. Data concerning the qualifications of Placement 
Directors are not included because an insufficient number of 
cases were interviewed. 

The sixteen members of the Committee are individuals who 
volunteered, during, the meeting last year, for service with this 
group. Their names appear below 3 . 

The committee did not have sufficient funds to meet, but 
President Wrcnn provided a small budget for visits by members 
to nearby colleges an*! universities. 

Mr. S. S. Davis, doctoral candidate ar the University of 
Colorado and member of the Committee, studied the colleges 
available for participation and made recommendations con- 
cerning the sample. He has developed the interview forms which 
were used ami has tabulated the data. A total of 5a institutions 
were visited by the Committee members. Of this number 13 
were '* large” institutions and 39 were "small.” Comparison with 
the college enrollments listed in the Office of Education Direc- 
tory* indicated that the sample was not very representative. 

* Gordon V. Arulmnn, Av.iMnnt Director of Telling and Guidance, University of 
Too*; Mary P. Bigelow, A'*.i-.<am Dean of Student Personnel, Stephens College; 
VV. W. Blacwer, Dean of Student*. Washington Slate College; A. Ralph Cam, Asso- 
ciate Director, Stevens lnutilutc of Technology; Marie A. Corrigan, Dean of Women, 
Catholic University of America ;S S. Davis, Graduate Student, University of Colorado; 
Paul L. Drtascl, Director of Counseling, Michigan State College; Lcan« W. related, 
Dean of Women, Ohio Wedcyan; Joe N Gerlvr, Director of Student Personnel, 
Nonhwe-.tcrn Stare College; Milton K 1 lain*. I >< *u "i Nr .-a- ns - . i'ln/gCHtr of Cali- 
fornia at law Angclst; Grant M. Ntireni, ih* . -nr .'■nidi-iu Pi i i-iiiii ', North Dakota 
State Teachers College; Ifomthy Polio,. I,, Dun t»r (.'.(■ip.itioii.d Guidance Service, 
Stephens College; Wilson 'fhiede, Director of Aiimi.-inn , University of Wisconsin;, 
Florence M. Thompson, Director of Womans Residence Hull, Indiana State leachsrs 
College; A, A. Weikk, Head of Counseling and Testing Services, University of New 
Mexico; Wiliam Davidson and Lois Gaunt of l). C. L. A, tutaisted also. , 

* Chxuiar 3jS. Washington: Federal Security Agency, Office of Educntion, 1947. 
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The Committee members could visit only a total of 5a colleges 
with the $25° of travel funds available. The comparison of 
Directory enrollments with the sample is as follows: 

Directory Sample 

’“Large 5 5% Large 1 $% 

*Small 86.6% Small 75% 

Medium 7.9% Medium - 0% 

“Large” institutions were determined to be those of 5,000 or 
more enrollment and “small” under a, 000 

The sample of colleges of education, technical colleges, etc., 
was not representative, due to travel limitations, but sufficient 
numbers were included so that some conclusions can be drawn 
safely from the data. 

There are thirty -one pages of tables in the report The budget 
of the Committee did not provide sufficient money for mimeo- 
graphing that much material Data which were considered to be 
interesting or significant have been placed in the Summary and 
Conclusions which follow; the number of cases was too small to 
warrant use of percentages. 

Summary 

Organization of Personnel Services . — Members of the Com- 
mittee discovered wide variations in the organization of stu- 
dent-personnel services, the titles of coordinators, if any, and 
the individuals who do counseling or guidance work. It was 
found that personnel workers in large colleges spend a greater 
percentage of their time in that work than do similar officials 
in small colleges. 

It is recommended that ACPA give consideration to the 
adoption and recommendation of standard, commonly-accepted 
and recognized titles for workers in the field of student per- 
sonnel. 

Coordinators . — Although only a small number of colleges is 
included in the sample, it is interesting to observe that the 
Doctor’s degree is possessed by or considered to be ideal by a 
significant number of Coordinators. There is no significant pat- 
tern of under-graduate major, but Psychology, Personnel, and 
Education are given frequently as ideal graduate majors. Col- 
lege and/or high-school teaching and personnel work are indi- 
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cated as the most common existing and ideal work-experience 
backgrounds. 'Ilie majority of Coordinators have been in their 
present work less than three years. 

Special courses deemed ideal for Coordinators were Counsel- 
ing, Personnel and Psychology. Most of the people interviewed 
expressed a favorable opinion concerning the desirablility of a 
period of internship for Coordinators; a year was mentioned 
most often as being desirable. A majority of those interviewed 
expressed the opinion that workers in this held should have em- 
ployment experience before they engage in graduate study. 
Throughout this report “employment experience’’ means teach- 
ing as well as other types of experience. 

Objectivity, satisfaction in helping others, adaptability, sense 
of humor, understanding, patience, approachability and sin- 
cerity were the personal characteristics checked most fre- 
quently, our of a list of 19, as being important for workers in 
this field. 

The most commonly mentioned deficiencies in training and 
qualifications were insufficient or inadequate training or work 
experience. The most common reason given for entering student 
personnel work was “ requested to do so by President or Dean." 

Deans of Women.- The majority of large and small college 
Deans of Women indicate that the Master’s degree is an actual 
and an ideal qualification. A noteworthy number of Deans of 
Women majored in English during their undergraduate study. 
Personnel, Education and Psychology were mentioned most 
often as ideal graduate majors. High-school and college teach- 
ing were indicated most often as actual and ideal work-experi- 
ence backgrounds. Special courses deemed ideal by a majority of 
Deans of Women were Education and Psychology. A substan- 
tial majority of those interviewed recommended a period of 
internship, of one year. An ovei whelming majority indicated the 
desirability of having some experience prior to graduate study 
The majority have been in their present positions less than three 
years. 

Six personal characteristics, out of a list of 19, were checked 
most frequently as being important in the work of the Dean 
of Women ; they are sincerity, approachability, sense of humor, 
understanding, objectivity and patience. The greatest defi- 
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ciencies in the training and qualifications of Deans of Women 
according to this and administrators’ conceptions of the ideal 
were lack of knowledge about counseling and guidance, in- 
adequate background and inability to work with people The 
most common reason given for entering this work was “Re- 
quested to do so by President or Dean.” 

TDeans of Men . — A majority of Deans of Men consider the 
doctorate ideal although a considerable number indicate the 
Master’s degree as being adequate There is no marked pattern 
of common undergraduate major but many small-college Deans 
consider a graduate major in Psychology or Education to be 
ideal. The majority of the Deans have been in their present 
positions less than three years 

The most common background of work experience of these 
individuals is college or high-school teaching. Many consider 
teaching experience ideal, experience in business or industry is 
indicated as being important, too. Special courses deemed as 
being ideal are Education and Psychology. A period of intern- 
ship of a year is indicated as being desirable by almost every 
Dean interviewed. Work experience before graduate training 
is begun is recommended by most. 

Eight personal characteristics were selected, out of a list 
of 19, as being important in the work of the Dean of Men; 
these are sincerity, understanding, satisfaction in helping others, 
patience, sense of humor, approachability, adaptability and 
broad-mindedness. Lack of training in counseling and lack of 
background of experience were the deficiencies in training and 
qualifications most commonly mentioned A majority of those 
interviewed entered the personnel field because they were re- 
quested to do so by the President or Dean. 

Counselors . — A majority of large -college Counselors inter- 
viewed have Doctors’ degrees and consider them ideal as qual- 
ifications; Committee members were unable, because of lack 
of time, to interview all Counselors Those Counselors reported 
on probably are the outstanding ones and, therefore, not com- 
pletely representative. The majority of small-college counselors 
have Masters’ degrees but their administrators consider the 
doctorate ideal. Psychology, Education or Social Science under- 
graduate majors were reported by some counselors. Psychology, 
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Personnel or Education graduate majors were given as actaal 
and/or ideal qualifications. The majority of these Counselors 
have been in their present positions less than three years 

College teaching was the most commonly mentioned actual 
and ideal work experience. Psychology, Counseling, Measure- 
ment and Statistics were mentioned most often as special 
courses deemed ideal, live vote for a period of internship was 
almost unanimous: one year was indicated most frequently 
A very large majority of those interviewed recommend ex- 
perience before the worker begins graduate training. 

The seven personal characteristics checked most frequently, 
out of a list of 19, as being important for Counselors, were 
sincerity, objectivity, warnvth of personality, pleasing person- 
ality, appmaehability, understanding and patience. The great- 
est deficiencies in training and personality were too little ex- 
perience in counseling while in training, lack of understanding 
of clinical practices and procedures, unsuitable personality and 
lack of a philosophy of counseling. A very small number of 
Counselors entered this work because they were requested to 
do so by the President or Dean. The majority planned to enter 
this field or were interested in it. Quite a few admitted that 
they had drifted into it. 

Committee members reported a wide range in titles given to 
counselors. There is need for standard titles and for better 
definitions of the terms "guidance" and "counseling." 

Directors of Student Activities. The majority of Directors 

have Masters’ degrees and many of them (and their adminis- 
trators) consider that degree ideal. A noteworthy number state 
that the doctorate is ideal. No particular undergraduate major 
is mentioned as being significant but Education, Personnel and 
Psychology are mentioned most frequently as ideal. The ma- 
jority of these workers have been in their present positions 
less than three years. 

Work in student activities and high-school or college teach- 
ing are indicated most frequently as being actual and ideal 
work experience prior to present position. The special courses 
deemed idea! for this work were Psychology and Education, 
Practically everyone agreed that a period of internship is de- 
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sirable. One year was recommended by the majority but two 
years were mentioned by several. A majority stated the opinion 
that employment experience should be provided before grad- 
uate training is begun. 

Eight personal characteristics were checked most commonly, 
in a list of 19, as being most important for Activity Directors; 
these are sincerity, understanding, sense of humor, objectivity, 
approachability, patience, adaptability and self-confidence. The 
greatest deficiencies in training and qualifications were given 
as inadequate training and experience. A small majority of 
those interviewed indicated that they entered this work be- 
cause they were requested to do so by the President or Dean, 
but a considerable number indicated that they had planned 
to enter it or were interested in it. 

Directors of Admissions and Registrars . — Many small-college 
officials in this category have only the Bachelor’s degree but a 
large majority of large- and small-college individuals indicate 
that the Master’s degree is ideal. A small number state that the 
doctorate is ideal. There is no clear-cut undergraduate pattern 
actual or ideal, but Education and Psychology are mentioned 
by many as ideal graduate majors. The majority of these 
Directors have been in their present positions less than three 
years. Generalizing on the basis of data available is dangerous 
because the number of cases interviewed was very small. 

The work-experience background of these individuals is so 
varied that no pattern, except high-school teaching (for several 
people), is worthy of mention. College teaching is the ideal 
experience mentioned most frequently. Special courses deemed 
ideal most frequently are Personnel, Education and Statistics. 
A very large majority state that internship is desirable; one 
year is the period mentioned by a majority. That work ex- 
perience should be provided before graduate training is begun 
is the unanimous opinion 

Nine personal characteristics were selected by these officials 
(out of a list of 19) as being most important for Directors of 
Admissions and Registrars; they are sincerity, self-confidence, 
adaptability, understanding, patience, pleasing personality, sat- 
isfaction in helping others, sense of humor and objectivity. 



4«2 l-tUT.VJION.St. AM) S'!,VCHOl.OC,K'AV. MEASUREMENT 

Inadequate training and experience were listed most com- 
monly as the greatest deficiency in training and qualifications. 
The majority of Directors indicated that they had entered this 
field rtf work because they were requested to do so by the Presi- 
dent or Dean 

Undergraduate Majors, • No field of educational personnel 
work included in this limited survey was characterized by ahy 
particular undergraduate pattern of major subjects. 

Graduate Majors. Coordinators, Deans of Women, Directors 
of Student Activities and Counselors mentioned Education, 
Psychology and Personnel Work frequently as ideal graduate 
major fields. Many Deans of Men and Directors of Admissions 
mentioned Psychology and Education as ideal graduate areas; 
they were not so apt to include the field of Personnel. Psy- 
chology, Education and Personnel were the courses mentioned 
most often as being deemed ideal. 

IFttrk Experience. College and/or high-school teaching were 
mentioned most frequently as the type of work experience en- 
gaged in prior to present |K>sition. 

‘internship. Although Committee members reported that 
ideas about internship are not dear, the opinion that it is desir- 
able was almost unanimous. The majority favor a period of one 
year. 

Employment Experience Prior to Graduate Study. — A very 
large majority of educational personnel workers favor employ- 
ment (including teaching) prior to graduate study. 

Deficiencies in Emitting and Qualifications. Insufficient or 
inadequate training or experience are mentioned most com- 
monly as deficiencies. Broad and general statements made in 
reply to questions about tit is matter indicate that some people 
interviewed are not well qualified to judge. 

Reason for Entering Personnel l Fork ---The majority listed 
“requested to do so by President or Dean” as the reason for 
entering this work. The only group in which a number indi- 
cated that they hatl planned to enter the field or had done so 
because they were highly interested, was the C ounselors, 

Length of Service . The majority of all workers studied had 
been in their present positions less than three years, 
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Comparison of Personal Characteristics Deemed Important. - 


By Coordinators 

Deans of Women 

Deans of Men 

Objectivity 
Satisfaction in 
helping others 
Adaptability 

Sense of humor 

Understanding 

Patience 

Approachabtlity 

Sincerity 

Sincerity 

Approachabtlity 

Sense of humor 

Understanding 

Objectivity 

Patience 

Sincerity 
Understanding 
Satisfaction in 
helping others 
Patience 

Sense of humor 

Approachability 

Adaptability 

Bro ad-mindedn ess 

Counselors 

Directors of Activities 

Director, of Admtsssions 

Sincerity 
Objectivity 
Warmth of person- 
ality 

Pleasing person- 
ality 

Approachabtlity 

Understanding 

Patience 

Sincerity 

Understanding 

Sense of humor 

Objectivity 

Approachability 

Patience 

Adaptability 

Self-confidence 

Sincerity 

Self-confidence 

Adaptability 

Understanding 

Patience 

Pleasing person- 
ality 

Satisfaction in 
helping others 
Sense of humor 
Objectivity 


Sincerity, patience and understanding appear in all six of 
these lists. Objectivity appears in five of the six, sense of humor 
in five, adaptability in four and satisfaction in helping others 
in three. Those are some of the “common” elements, a com- 
parison of the lists reveals others that may be unique for that 
group. There obviously is great need for studying educational 
personnel jobs and discovering some of the personal and pro- 
fessional qualifications essential to success. The Committee is 
not convinced that these ratings are very reliable. It does be- 
lieve that personal characteristics are important. 

Conclusions 

It is dangerous to generalize on data derived from such a 
small number of cases and a sample that is not completely repre- 
sentative but certain conclusions can be drawn. 

The “professional” training of educational personnel workers 
is often not truly professional in nature but Gordon Anderson, 
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Committee member, made a significant observation when he 
wrote to the Chairman; 

The training effects nf experience cannot adequately be re- 
flected by canvassing previous training of personnel workers 
who may !« leaders in the field toil ay, VVe find that previous 
training and experiences, which we have had, to be useful in 
one way or another and there seems to be a strong tendency to 
want to impose this same pattern on others:- it is impossible 
to evaluate the possible usefulness of training and experiences 
that one has not hath 

W. W. Blaesscr, Committee member, last year made what 
Clifford Kroclich* would classify as External Criteria Evalua- 
tion of student personnel work being done in the member col- 
leges of the Western Personnel Institute. Blaesser will discuss 
evaluation during the ACPA meeting Wednesday morning so 
the Chairman will refrain from commenting extensively, but it 
is pertinent to remark that after the survey was completed he 
was of tfie opinion that the colleges had a tendency to overrate 
themselves. 

In the study which is reported on today members of the 
Committee found, however, that many educational personnel 
workers did hot indicate ideal, graduate training as being the 
area which they had studied. A great many of the people inter- 
viewed indicated that Education, Psychology or Personnel 
would be desirable graduate majors. The same subjects were 
mentioned, as well as guidance, counseling, testing and sta- 
tistics, when these individuals were asked "what special courses 
arc deemed desirable." Committee members agree that some 
college administrators did not see the need for training student- 
personnel workers. 

It appears that many college personnel workers who do not 
have training for their jobs rccogn ize the lack of it and the 
desirability of providing it for individuals who enter that field. 
The worker may feel that he is doing reasonably satisfactory 
work, because he has learned on the job, but he recognizes the 
need for professional training. Deficiencies in training and qua!* 
ifications mentioned most often are insufficient or inadequate 
training or experience. This is not surprising when one f,eH 

* Frocllch, Clifford. Evaluating Guidance I'reetdures, J Review oj the Literature, £ 
Washington: Federal Security Agency, Office of Education, 1949, {^ i 
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fleets on the statement that the most common reason given for 
entering student-personnel work was “requested to do so by 
President or Dean.’’ The fact that so many people gave this as 
their reason is no reflection on them and may indicate excellent 
personnel selection by the administrators; it certainly is an 
indication of the fact that there has been a great demand for 
educational personnel workers during the past few years and 
that there has been a shortage of supply. The fact that so many 
college personnel workers indicate high-school or college teach- 
ing as a common area of work experience prior to entering their 
present position, and that they consider this desirable, is signifi- 
cant. 

The fact that the majority of personnel workers interviewed 
had been in their present positions less than three years is an 
indication that many individuals have been recruited for this 
work comparatively recently. Perhaps this is the reason for the 
wide variations reported in duties performed and for some dis- 
crepancies between titles of personnel workers and the jobs 
which they do. 

Recommendations 

i. The Professional Standards and Training Committee re- 
commends that a job analysis be made of the work being done 
by a carefully-selected sample of student-personnel workers. 
Job descriptions might be used as a basis for establishing ideal 
standards for various personnel jobs. 

i. It is recommended that ACPA encourage several colleges 
and universities, which are included in the job analysis study, 
to evaluate their counseling services over a period of several 
years . 

3. It is recommended that ACPA prepare reports of job 
descriptions, evaluations and standard job titles and make them 
available to college and university administrators. It seems ob- 
vious that professional status cannot be hoped for until college 
presidents recognize a standard job title and description. The 
teaching profession, too, is confused by the “Babel of tongues. 
How can we expect the general public to understand our work 
when it is so chaotic? It is suggested that the nature of student 
personnel work and qualifications of workers be discussed at 
meetings of college Presidents. 
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4. When reports on standards of training and qualifications 
wf college personnel workers become available, it is recommended 
that they !>e senr to appropriate officials -the Presidents of 
colleges and individuals who are engaged in the training of per- 
sonnel workers, 

<. It is recommended that the terms "counseling” and “guid- 
ance" be defined so that members of our "profession,” indi- 
viduals engaged in training jiersonnel workers, college admin- 
istrators and faculty members may use the words wisely and 
well. Some standard terminology is basic to the development of 
standard* in training and practice. 



ONE PHASE OF HIGH SCHOOL-COLLEGE RELATIONS 

HAROLD A ADAMS 

Director, High School Student Relations and Orientation, University of Washington 

Since “Bridging the Gap Between Secondary School and 
College” is a rather broad subject, it seemed wise to focus our 
attention on a single phase of the problem, namely, high school - 
college relations. In so doing, an attempt has been made to point 
out a few ways in which colleges may be of assistance to high 
schools in serving their college-bound students. 

Before undertaking any discussion it may be well to clarify, 
or restrict, the meaning of the term “high school-college rela- 
tions” as used in this paper. A letter of inquiry was sent out 
recently to some fifty western colleges in which directors of 
admission were invited to describe features of their respective 
high-school relations programs which might prove of interest to 
this assembly. Furthermore, they were asked to submit pub- 
lications which had been found useful to prospective students. 
Judging from the replies and the publications, far too many 
directors of admissions think that high school-college relations 
begin and end with student recruiting. This discovery was 
somewhat disturbing because this practice needs to be reduced 
to a vanishing point in any constructive high-school relations 
program. 

On the other hand, certain replies were encouraging, for they 
indicated that, at least among a considerable number of college 
people, recruiting was falling into disrepute . 1 Precollege guid- 
ance” suggests more accurately the methods now being used 
by some of these institutions. 

You may well ask, “What is the difference between ‘re- 
cruiting’ and ‘precollege guidance’?” 

In recruiting, a college competes through pressure techniques 
for the enrollment of a desirable student. He may be desirable 
as a fullback, an oboe player, or as a scholar. The reason is 
immaterial. The tragedy in the situation is that little attention 
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is given to the student's aptitudes, interests, or background as 
they relate to the college and its program. The student is treated 
as expend able. 

The primary objective of all high school-college relations 
should be to promote student welfare. Thus, the student and his 
future become the first considerations in precollege guidance 
rather than the selfish interest of the college, A sincere effort 
is made to guide the student towards matriculating into a col- 
lege which cart offer him a challenge and which can develop 
his aptitudes and interests, while at the same time is in keeping 
with his* family b.v kgroimd and his economic status. Ideally, 
the high-school counselor and the college representative should 
share in bringing the salient features of the situation before the 
student anti his family. The decision rests with them. 

"Now," you say, "suppose two or more colleges are equally 
able to meet these requirements. What then?" The fact still 
remains that recruitment and precollcge guidance are funda- 
mentally two different means of dealing with high-school stu- 
dents. They dn not merely represent the difference in degree 
by which college personnel workers may vacillate according to 
the times whether hard or prosperous. The answer is this: 
Every student seeking help on the choice of a college has a right 
to expect the same objectivity and sincerity on the part of the 
high-school and college counselors in this as in all other situa- 
tions. This requires as complete an elimination of recruitment 
aa is humanly possible. 

We assume responsibility for the satisfactory orientation of 
students in college when we accept their welfare as the objective 
in high-school relations. There are many young people who, 
given the chance, would profit immeasurably from college ex- 
perience. There are others who should never have enrolled 
because of their inability to adjust to the demands of higher 
education. In order to eliminate such unnecessary disorientation 
preventive measures must be taken in high school, long before 
the situation becomes acute on the college level. High schools 
and colleges must cooperate in carefully timing a joint attack on 
the orientation problem before the students’ post high-school 
plans have crystolized. 

The cooperative attitude is so essential to success in all 
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phases of high school-college relations that it may be considered 
a basic principle. This relationship is a two-way, give-and-take 
proposition, involving the exchange of information, a sharing of 
responsibility, and an equal opportunity for initiative, with 
neither participant attempting to dominate the other. 

Since I am expected to describe developments in the western 
states, I should like to cite a few examples of what is being done 
cooperatively in this area to promote the more satisfactory 
orientation of students in college. The advances made recently 
in such cooperative programs as statewide testing and the 
in-service training for counselors are significant enough to war- 
rant devoting an entire session to them alone. As a matter of 
fact, I believe Dean Cole plans to develop this point in his 
paper. This type of project exemplifies good high school-college 
relations in that mutual responsibility is required, dividends 
are shared, and in the final analysis, the greatest benefits are 
dealt to the student. 

Among the publications submitted was a booklet entitled 
You’d Like to Yeach. The committee responsible for this pub- 
lication of Central Washington College of Education eliminated 
almost entirely propaganda about the college itself. Illustra- 
tions of other Washington institutions were used and the field 
of secondary education was included, despite the fact that the 
college was not at that time training high-school teachers. The 
book is being widely used by high schools as a source of infor- 
mation about the teaching profession. Such selfless contribu- 
tions as this are commendable 

An interesting departure from routine high-school relations 
is Dr. Merle Kuder’s experiment in selective teacher recruit- 
ment at Western Washington College of Education. High- 
school principals in the locality are asked to nominate a given 
number of "superior juniors,” superiority being defined in this 
case in terms of those qualities conducive to success in teaching. 
These juniors are then invited by the College and by the high 
school jointly to thoroughly investigate teaching as a career . 
The opportunity is one of a project in career study, not one of 
selling teaching as a vocation. The experiment involves the 
following steps: 

1. A day on the campus of a teacher-training institution. 



EDtJCATIO MAE ANIt PSYCHOLOGICAL MEASUREMENT 

Emphasis is on the teacher at work which gives the stu- 
dent firsthand information through observation of what 
is gained from professional teacher’s training. It is not a 
day spent in listening to lectures, 

2. Follow-up during the senior year by the high-school coun- 
selor or teacher with small group meetings, personal con- 
tacts with teachers, administrators, and specialists, and 
exposure to selected literature and films. 

It is too early to know the results of this experiment. How- 
ever. there is already some evidence that, as a result of this 
experience, a number of these superior youngsters are planning 
careers in teaching who would not otherwise have done so. In 
many instances, the elimination of the common prejudices 
about teaching and an understanding of some of its intangible 
rewards have been sufficient to motivate serious consideration 
of teaching as a career. 

This is just one of the devices being used to attract the right 
students to college: visits to campuses by high-school honor 
students; department -sponsored conferences, clinics, festivals, 
etc.; open houses; college -sponsored programs in high -school 
assemblies; anti manyothers too well known to need elaboration. 
These are all legitimate and valuable, providing the college plan- 
ning committee keeps the specific objective of the particular 
program foremost and docs not allow the occasion to degen- 
erate into a convenient vehicle for selling the college. 

Many high-school principals arc following-up their graduates 
who enter college in order to obtain information which might 
be helpful in revising the curricula and guidance services in their 
high schools. Colleges cooperate in this activity by presenting 
progress reports on the students to their former principals and 
by arranging conferences for them. In these conferences, the 
college students state to their former principals their reactions 
to college life and the principals in turn report their comments 
back to the college personnel officers. Through these reports, 
high schools can improve their preparation and colleges can 
strengthen weak points in their orientation of new students. 

Mr. Hiram Edwards, Director of Relations with Schools at 
the University of California and Secretary to the Committee 
for the Study of Education, was extremely gracious in pro? 
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viding material for this discussion. In spite of the information 
given me, I feel unqualified to describe in great detail the ac- 
complishments of the Committee I shall, therefore, be brief 
and trust that some Californian will contribute additional in- 
formation during the discussion period. 

This Committee for the Study of Education is composed of 
representatives from the State Board of Education and from 
all educational interests, elementary through university, both 
public and private. It acts in a steering capacity and leaves the 
actual work to sub-committees of experts. One sub-committee 
recently completed a report on the articulation of foreign langu- 
age study. Others are working on such problems as general 
education, accreditation, admissions, uniform course names and 
numbers, conservation education, mathematics-education, and 
a combined high-school transcript and counseling blank. Its 
annual report appears in California Schools, a monthly publi- 
cation of the State Department of Education. Financial sup- 
port is derived from participating professional associations and 
from such sources as the Rosenberg Foundation Although the 
work of the Committee for the Study of Education extends be- 
yond the scope of our assigned topic, the professional character 
of its program and its bearing on high school-college relations 
is noteworthy. 

Now I should like to describe the Interstate Council on High 
School-College Relations as it developed and operates in the 
states of Oregon and Washington. In outlining its history and 
progress, I have drawn frequently from the Foreword to 
Mapping Tour Education a book published by the Interstate 
Council. For permission to do this, I am grateful to the co- 
editors, Dr. Merle Kuder, Director of Student Personnel Ser- 
vices at Western Washington College of Education, and Mr. 
Douglas McClane, Registrar and Director of Admissions at 
Whitman College; both men were instrumental in the forma- 
tion of the Interstate Council. 

In Oregon and Washington, as in other parts of the country, 
educators have for many years been discussing closer coopera- 
tive relationships between high schools and colleges. Various 

1 Merle S. Kuder and Douglas V McClane. Mapping Your Education (Portland, 
Oregon, 1947 ) 
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programs were developed in different sections of the North- 
west which took the form of college-day conferences, college 
guide honks, and a number of other enterprises. 

After the war, groups and individuals representing a variety 
of educational interests “raised the question of whether it would 
be possible to unite dissociated efforts and form one over-all 
organization which would function with perspective and ef- 
fectiveness." 2 After considerable exploratory work, a meeting 
was called in Portland in October, 1946. The group of delegates 
decided that there was much which could be accomplished in 
association and agreed to assume responsibility for cooperative 
activity. “It, therefore, organized itself as the Interstate Com- 
mittee on High -School -College Relations.'"* (Recently, the term 
“Council" has replaced that of “Committee” as part of the 
title.) 

The Council is now composed of 23 members, equally divided 
between the two states as follows: 


Oregon High School Principals Associa- 

tinn . . ■ - 4 delegates 

Washington High School Principals Asso- 
ciation ' 4 

Oregon State Department of education 1 

Washington State Department of Educa- 
tion . , ; I ‘ 

The State Cniversities of Oregon and 

Washington 2 (1 each) 

The State Colleges of Oregon and Wash- 

ington . . a (teach) 

The accredited private colleges and univcr- (< 

ritics of Oregon - • 2 

The accredited private colleges and uni- 
versities ofWashington. ... . . . • - • . ■ ■ 3 
Hie accredited private high schools of Ore- ( 

gon and Washington t 

The public junior college* of Washi ngton 1 


The fact that there is equal representation from each of the 
two states allows for cither half to operate independently on 
matters of concern in a single state, or, to act together as a 
Courvcil-of-thc-wholc when there is mutual interest, The entire 
group gathers for an annual meeting each January. An executive 
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board and sub-committees meet in the interim to implement 
plans outlined at the annual meetings. 

The Council functions as a consulting and recommending 
group to coordinate the thinking of both the college and second- 
ary school levels on various common problems. These functions 
are dictated by the nature of the problems rather than by gen- 
eral constitutional procedure. However, the Council may ini- 
tiate and support activity of common concern to the high 
schools and colleges of both states. 

The Interstate Council is prepared to consider and promote 
only such activities as are of concern to both public and private 
education on both the secondary and higher levels. It assumes 
responsibility for projects of mutual concern which may be 
delegated to it by any element of the organizations and institu- 
tions its membership represents, or by official agencies of other 
recognized educational interests in Oregon and Washington, or 
for projects which it, as a Committee-of-the-whole, may de- 
vise. . . . Before undertaking a major project, committee mem- 
bers obtain the approval of the institutions or organizations 
they represent. 

The Interstate Council recognized and emphasizes (1) that 
its function as a Committee-of-the- whole is only that of a co- 
ordinating agency; (a) that the members of project- working 
committees are not necessarily limited to the twenty-two dele- 
gates constituting the personnel of the Committee, but, rather, 

(3) that in the name of the Interstate Council, many different 
qualified persons from the high schools, colleges, universities, 
and departments of education of Oregon and Washington may 
be called upon to serve on working sub-committees of the Inter- 
state Council. 4 

There are now Interstate Council sub-committees responsible 
for the high-school visitation program in each state Together 
they formulate a bi-state schedule of visits to areas where high 
schools desiring to participate are located. From this point on- 
ward, the two sub-committees operate independently, since 
there are some variations in the two state programs. 

I should like to digress a moment in order to explain how the 
joint visitation program came into being. About fifteen years 
ago the principals of southwest Washington expressed dissatis- 
faction with the recruiting done in their schools by representa- 
tives of northwest colleges. They objected to the recruiting and 
also to the continual disruption of spring semester classes by 

4 Statement of Principles of the Interstate Council on High School-College Relations, 
January, 1949. 
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marauding representatives. I .csser men would have merelyclosed 
sheir doors To overcome this undesirable practice, the prin- 
cipals conceived the idea, later adopted and refined by the 
Interstate Council, of having joint high -school visitations. In- 
terestingly enough, it was the principals who first recognized 
a need for special help on the part of college-bound students; 
also, it was they who initiated a plan which became the solu- 
lion to their problem Incidentally, the colleges are to be 
credited in that they refrained front imposing a program of their 
own, anti those t«> assist in the cooperative development of a 
conference plan which has been found reasonably satisfactory 
to all concerned. 

In Washington, the visitation group is composed of repre- 
sentatives from both public and private institutions of Wash- 
ington and private colleges of Oregon. The representatives 
travel together an.! stop at strategically located host high 
schools according to a prearranged schedule set by the sub- 
committee. On the appointed day seniors from the host as well 
as from neighboring schools gather for cnnlerenccs with the 
college representatives. Each student attends three 30-minute 
group conferences. Kvcn though he may have already decided 
upon Ins college, he is required to visit conferences held by the 
representatives of the three colleges in which he is most in- 
terested. The reason for this practice is that cxjxisure to various 
educational points of view, as expressed by colleges of different 
types through their representatives, is considered important in 
the educational planning of any serious student. At the con- 
clusion of the third group-conference period, students are free 
to circulate among the representatives to gain further infor- 
mation through interviews. 

Prior to the conference, each representative is provided with 
a confidential personal data sheet for each student who indi- 
cated an interest in that particular college. On the data sheet 
is found the usual personal information plus the student’s 
fields of vocational interest and, most important, the counselor’s 
estimate of his probable success in college. This prediction may 
be expressed in one or more of the following ways; grade aver- 
age, rank in class, test scores, or a rating scale, Elowever ex- 
pressed, it enables a qualified representative to do as much con- 
structive guidance as time permits. 
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When representatives of small private colleges find only a 
few interested students, they may complete their conferences 
early and be free to lead discussions in freshman, sophomore, 
or junior classes, All representatives are prepared to accept, 
on short notice, such invitations from host principals. These 
discussions have proved helpful in stimulating younger stu- 
dents to think more seriously about career planning, vocational 
choices, aptitudes and interests, etc. Reference to specific col- 
leges and any undue emphasis on the desirability of a college 
education for all students are studiously avoided. 

One can easily imagine a conference being something of a 
Roman holiday, and so it could be. The value, or else the con- 
fusion derived from this information service (and it is this, 
rather than either counseling or recruiting), depends entirely 
upon the effectiveness of the high-school counseling and guid- 
ance program. Experience indicates the necessity of adequate 
preparation and follow-up by the high-school staff. Without 
this, more harm than good may result. 

The freedom of students to return after the group confer- 
ences to ask questions of representatives serves as a check on any 
unindoctrinated representative who may join the visiting group. 
High-school students have a peculiar sensitivity to extreme 
statements, and they seem to take pleasure in repeating them 
for people who are sure to be interested. It is this tendency for 
"word to get around” which keeps the conferences and inter- 
views on a surprisingly high ethical plane. Students have criti- 
cized the visiting group before their high-school counselors on 
the grounds that the representatives did not seem sold on their 
own colleges. The colleges accept such statements as compli- 
mentary. 

In Oregon there are two series of high-school visitations, one 
for the state system and one for the independent colleges. 
The latter band together and, in company with representatives 
of a number of independent colleges of Washington, operate 
along the lines of the Washington plan just described. The 
Oregon State system of higher education has a single visitor 
who represents all of the state-supported institutions. Recently, 
however, a representative of the state colleges of education has 
been accompanying him to promote interest in teaching as a 
profession. 
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The foregoing dhctmion of high school visitation serves to 
illustrate projects on which the Oregon and Washington sec- 
tions of the Interstate Council operate more or less independ- 
ently. The book. Mapping Tour Education , serves to illustrate 
the cooperative effort displayed by the Council as a whole, 
Prom the Ivtok's foreword I quote: 

The pro}* waI to piblr-h a gmdclas.k that would be useful to 
high M-h'H'l '■ttidruU's, cotincrlor-*, parents, ami others interested 
in plannrd education had its incentive in the fact that small 
ltt*ok5et?i had Inert published i ti the past by high school-college 
intcrcMS an both Oregon and Washington. A lawklet entitled 
Mapping Your Education originally was prepared in 1 94 1 at the 
request «<f principals in Southwest Washington by a group of 
college regoirMrs, including several members of the new Inter- 
state Council. The success of this lw» iklet indicated that a larger 
and more comprehensive publication should be prepared in re- 
sponse to widespread recognition of similar demands in other 
areas, 

Agreed upon as basic by the Interstate Council were the 
principles (f) that such a publication should be undertaken 
jointly by high schools and collegiate institutions; (a) that the 
bent thinking from both interests concerned should be incor- 
porated in the book, and C?) that the cost of publication should 
las shared. Accordingly, the I’lan of Part 1 and much of its sub- 
ject matter are based upon the returns from a Composite Judg- 
ment Sheet circulated among all high schools and collegiate 
institutions in the two states. Cost of the publication was met 
by the purchase of space by participating colleges and univer- 
sities and guaranteed subscriptions from cooperating high 
schools. Further, it was agreed rfi.it the proposed book must be 
attractive in format and readable by high school students. 
Finally, it was agreed that the publication should consist of two 
parts: one, a carefully developed prttgram of educational plan- 
ning for high school students on « basis of realistic self-guidance; 
and two, concise, uniform presentations of facts submitted by 
the collegiate institutions of Oregon and Washington, concern- 
ing the educational opportunities each affords. 

In every college and university there are students who might 
have been better served by going elsewhere^- to a different col- 
lege or directly into employment. Every high school, college, 
and university recognized this condition and would eliminate it 
if possible, Mapping Your Education is published to provide 
high school students and those who advise them with a basis for 
the sound educational planning which can avoid this kind of 
dislocation. 

Although this book expresses much fundamental agreement 
on the nature and requirements of educational planning no 
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publication undertaken on a cooperative basis could reflect 
complete unanimity at every point. It should, therefore, be 
clearly understood that the high schools and collegiate institu- 
tions which have cooperated in making this publication possible 
may not fully subscribe in every detail to the points of view ex- 
pressed in Part I. In Part II, however, each collegiate institu- 
tion presents its own descriptive statement. 

Over-all responsibility for the preparation of Mapping Your 
Education was assigned to the co-chairmen of the Interstate 
Council: Dr. Merle S Ruder, Director of Student Personnel 
Services, Western Washington College of Education, and Mr. 
Douglas V. McClaine, Director of Admissions and Registrar, 
Whitman College. 8 

The six chapters of Part I are as follows: 

Is This Book For Ton 1 — in which the reader is informed that 
this is not a book to curl up in a corner with, but one which will 
require an expenditure of time and energy. 

Planning Your Ltje — in which the responsibility for setting 
the direction is placed squarely on the shoulders of the student. 

Planning Your Career — after pointing out a few of the pit- 
falls frequently encountered by young people in career planning, 
the authors direct attention to self-analysis and vocational 
analysis. 

Education — What Is It? — the distinction is made between 
education and schooling. The various types of schooling avail- 
able to a high-school graduate are then described. 

College or Not — the authors first point out the fallacy in some 
of the most common reasons given by students for attending 
college. Then there is a discussion of what one may expect to 
find in college, what one may expect to achieve, and what it 
takes to be successful in college. 

Choosing Your College — more pitfalls are cited, this time in 
relation to the choice of a college. This is followed by a presen- 
tation of criteria useful in selecting a suitable college. 

The student is led step by step through a process of self- 
analysis to a point at which he is encouraged to do one of two 
things, eliminate college as a suitable objective or think ser- 
iously about selecting one which will fulfill his needs. This 
brings the reader to Part II which includes a section on the 


4 K/ud er a nd McClane, op. ctt , pp lii^ivr 
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follnwina topics for c.u h of the- thirty-eight colleges of Oregon 
and Washington: 


'"ClencMS Inform a* 
t»««n“ 

* * Acrred i t a n*m * " 
"Types of Training 
Offered" 


"Admi*Mans" 

"Cost*" 

"( fpportunities to 
Supplement 
Cat li Resources” 


"Student Person- 
nel Proa ram ” 

“l ife Outside the 
Classroom” 


At the present time, the Council is considering a revision of 
h tap ping Tour Education. Already the suggestion has been 
made that a glossary of college terms be included. There has 
also been some demand from the high schools for a syllabus or 
work-book for use with the volume. A second edition may have 
a less expensive binding, since there is some question as to 
whether or not the high schools will replace Woks which are 
still in usable condition. 

This discussion of the Interstate Council and its projects will 
serve to illustrate its functions. The Council realizes that it has 
only scratched the surface and that there is a certain super- 
ficiality abut its accomplishments to date. Nevertheless, the 
organization is unique in that it transcends state lines, insti- 
tutional differences, the profit motive, and student recruiting 
practices. 

Before the current school year is over, the colleges and high 
schools of Oregon and Washington will be asked to contribute 
a modest sum to support the work of the Council, The response 
to this request will determine the future of the organization. 
If it is given the green light, it may have the courage, and ulti- 
mately the staff, to attack more fundamental problems such as 
those undertaken by the California Committee for the Study 
of Education. 

It is interesting to note that the members of the Interstate 
Council had been operating informally for some time before 
they were organized. The visitation program developed spon- 
taneously as did Mapping Tour Education. No faction of the 
organization has ever tended to impose upon or dominate 
another, and the welfare of the student has always been its 
primary concern. 

Time has limited us to n series of rather brief sketches. I 
•wish it were possible to say something about adding spice to 
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college catalogues, (which are usually insufferably dull) and 
deglamorizing some of their other publications 
High school-college relations is an area of service which is 
still in a nebulous stage. On most campuses the various projects 
connected with this sort of work have usually been distributed 
among several different offices with little coordination and 
long-range planning. Recently, however, some institutions have 
established high-school relations offices which are independent 
of such divisions as admissions, public relations, and student 
affairs. This trend indicates that high school-college relations 
are becoming more clearly defined in their development. Re- 
gardless of the organization and administration of these offices, 
the same principles of student welfare, cooperation, and service 
are fundamental. Colleges which confine their high-school re- 
lationships to recruiting may rest assured that they are receiv- 
ing something much less than ioo per cent cooperation from 
their constituent high schools Furthermore, they may expect 
downright resistance from the high schools who have enjoyed 
the fruits of real cooperative endeavor. 



SECURING FACULTY COOPERATION IN THE 
STUDENT PERSONNEL PROGRAM 


I) W AIKEN 

Director, Stw-ttm (n»M*ftec, Mitw^ Siatc College 

In unke 'f raining of Faculty Counselors 

This paper in concerned primarily with some of the methods 
used m securing faculty participation in the student personnel 
program at Mississippi State College. This institution is the 
Land-Grant College for Mississippi and has five divisions or 
schools; namely, Agriculture, Business, Education, Engineering 
and Science. The total enrollment of 3600 is predominantlymale 
with only no females in attendance. Since this College has not 
haul a completely organized Student Personnel Program, the 
discussion will concern faculty cooperation in counseling rather 
than the entire program. 

An organized program of student counseling at this College 
is in its infancy since it was inaugurated as recently as the fall 
semester of 1945. In its inception the efforts of the Administra- 
tion were directed towards a gradual and continuous develop- 
ment rather than an attempt to launch a full-scale program in 
the beginning. This procedure seems to have been wise and has 
resulted in a sound program. It has grown gradually as the 
Faculty developed through experiences in implementing a sound 
and conservative organization for rendering aid and assistance 
to students in solving their various personnel problems. 

The enrollment of this institution, like other colleges and 
universities, increased in the post-war period to the extent that 
all facilities of the College were taxed to the limit. The increased 
enrollment resulted in large classes accompanied by heavy 
teaching schedules for the Faculty, 

The Student Personnel Program was given emphasis by the 
establishment of the Veterans Ad ministration Guidance Center 
on the campus in June, 1945. The results and success of this 
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center have tended towards the promotion of counseling on the 
part of the Faculty by demonstrating the values obtained from 
counseling of veterans 

At the suggestion of the President of the College the Faculty 
of each of the five Schools inaugurated a study of the needs for 
an organized program of counseling for all students As a result 
of this study each school selected one faculty member to serve 
on a Counseling and Testing Committee for the College. 

This Committee was given the responsibility for recommend- 
ing to the Faculty the type of program that seemed to be best 
suited to the facilities of the College and the needs of its stu- 
dents. The plan submitted by the Committee was approved by 
the Faculty and administrative authorities of the College. The 
organization and administration of the program were assigned 
to this Committee with the Chairman serving as chief admin- 
istrative officer. All records and correspondence were routed 
through this central office, which tended to coordinate the 
counseling functions of the Faculty. 

The Committee inaugurated the first orientation program for 
all entering freshmen, in January, 1946. Numerous data were 
collected on each new enrollee prior to his official registration, 
including personal information, tests results, counselor sheets 
from admission blanks, and the high-school transcript. Six 
tests of aptitude, interest and achievement were given to each 
student during the orientation period. The results were inter- 
preted by members of the Counseling and Testing Committee 
for the student prior to his selection of a school or major area 
of study, and official registration. Refresher courses in English 
and mathematics were recommended to students on the basis 
of the results of the English and mathematics tests. Registra- 
tion advisers utilized these data in scheduling the first-year 
students. 

Immediately after registration the student was assigned to 
a Faculty Counselor, with a maximum of 15 students to each 
Counselor. The Counselors were selected from the various 
Schools by the Counseling Committee and the Deans on the 
basis of interest, experience, training, personality and willing- 
ness to assume these extra responsibilities. 
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Experience wem* to indicate that the Faculty at Mississipni 
State College were of three types insofar as training and atti- 
tude fman! student cmm-wling were concerned, namely, 
i Tinea- with a definite interest and a student personnel 
point o/ view, yet limited in training and experience in 

counseling 

2, Those w hose general knowledge anrl interest in counseling 
were limited, yet who were receptive and sympathetic 
toward the program 

j. Those whose superficial knowledge of the purpose and 
objectives of cottcrling and whose educational philosophy 
resulted in definite opposition and skepticism toward the 
program, This group seemed to adhere to the philosophy 
that the only purpose, of higher education was to impart 
subject matter in specific courses. 

The first two croups have proven to in- the most fertile sources 
for obtaining faculty advisers and counselors. However, some 
converts have br*-n recruited from the third group. This fol- 
lowed, as knowledge »>f the function and purpose of counseling 
was obtained by the group through contacts with other faculty 
members who were cooperating in the program. 

The Freshman Counselor had responsibility fur assisting stu- 
dents in the solution of the minor or routine problems that de- 
veloped from time to time during the student's first year of en- 
rollment, Some of the responsibilities of these Counselors were 
ax follows: Course selection and registration, activities, clubs, 
scholastic difficulties, and financial problems. Major problems 
of the students were usually referred to the members of the 
Counseling; Committee. Upon the completion of the freshman 
year the student was transferred to a major adviser, usually a 
Department Head or Associate Professor in the student’s major 
field. This major adviser has responsibility for the student dur- 
ing the last three years of his enrollment. 

Among the major problems encountered in the selection of 
the Counselors was that dealing with offering additional salary 
or decreased teaching load to those participating in the pro- 
gram. In the beginning the Committee was inclined to believe 
that an increase in salary or a stipend for participation as a 
Counselor was more desirable, and plans had been formulated 
to follow this procedure in 1948-49. However, some opposition 
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developed to this procedure from several sources. The chief 
argument against it was that instructors are assigned full teach- 
ing loads and the addition of counseling duties would probably 
mean that either instruction or counseling would be neglected 
Others pointed out that paying additional salary for counseling 
duties would not necessarily result in the faculty member 
functioning as a Counselor. Some stated that those faculty 
members who did not participate in counseling would be dis- 
satisfied because of the salary differential among members of 
the same academic rank, and the non-counselors would even- 
tually secure salary adjustment comparable to that of the coun- 
selors with similar rank. 

The problem of salary increase or decreased load for per- 
forming counseling duties was presented to the fifty Faculty 
Counselors for consideration. After some study, the group rec- 
ommended that the Faculty Counselor’s teaching load be de- 
creased where feasible and practical rather than increase the 
salary. This decision is one indication that the counselors re- 
alized that time is needed to aid the student in solving the 
problems encountered in college. This procedure has been fol- 
lowed during the current year with relatively little difficulty. 

The experiences in selecting and supervising the Faculty 
Counselors lead to the conclusion that interest in aiding stu- 
dents rather than an increase in salary or a decreased teaching 
load is the major motivating factor in determining the success 
or failure of the Counselor. There seems to be little relation- 
ship between the age or teaching experience of an instructor 
and interest in aiding students through counseling. It seems safe 
to assume that the apparent lack of experience, and knowledge 
of counseling, regardless of the age of the instructor, were the 
dominant factors which influenced instructors to display a 
negative or uncooperative attitude towards counseling. 

Plan for T raining Counselors 

Assuming that the lack of interest in student counseling is 
due in part to deficiencies m training and experience, the next 
step obviously was to devise plans and procedures for acquaint- 
ing the Faculty with the underlying philosophy of counseling 
and to implement means for giving some experience and train- 
ing to all prospective counselors. 
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An in-service training program was instituted by the Coun- 
seling and Testing Committee of the College during the early 
•stages of the program in 194b. The Faculty Counselors met 
frequently under the leadership of the Committee to study the 
procedures ami techniques of counseling. These meetings tended 
to emphasize the fact that the Faculty Counselors needed con- 
siderable information and training in order that they might 
perform the function's required of successful Counselors, since 
many did not know how to proceed, and yet were reluctant to 
admit if. 

Several plans for giving additional training were considered, 
namely: (a) Summer study by faculty members at other col- 
leges or universities, (K) Granting leaves to key personnel dur- 
ing regular session, fc) Offering an intensive course during the 
summer on the campus for the Faculty. 

The first two plans did not appear to be a solution to the 
problem since only a few individuals could study through these 
procedures. Since the College was not in a position to finance 
graduate study for its Counselors, and the majority of the 
Counselors’ chief pay-roll job was teaching, these individuals 
would have l«cn reluctant to spend a summer in the study of 
work which was of secondary consideration to them, at least 
from a financial standpoint. Therefore, after due consideration 
was given to the procedures for developing the Faculty in 
counseling abilities, it w as decided that plan three would serve 
most effectively the needs! of all the counselors. Therefore, defi- 
nite plans were made for organizing and developing a course on 
the campus of Mississippi State College. 

The first course for the Faculty Counselors was held during 
the summer of 1 94S. This w as a six- weeks course on the graduate 
level, meeting one and one-half hours per day, five days per 
week. All fees were waived for College employees and approxi- 
mately 50 per cent of the 46 members enrolled in the course 
registered for credit regardless of the fact that many held ad- 
vanced degrees. The registra tion for credit resulted from a desire 
on the part of the faculty members to have the course made a 
part of their official records. 

The group was composed of Freshmen Counselors, Depart- 
ment Heads, Major Advisers, and members of the Counseling 
and Testing Committee. The Academic Deans met with the 
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group, as their duties permitted. Each School of the College, 
and the majority of the Departments were represented. 

Two specialists in the field of student personnel work were 
secured as leaders or instructors for the course Dr Donald E. 
Super, Columbia University, taught the course for the first 
three weeks, and Dr. Fred McKinney, University of Missouri, 
was in charge for the last three weeks. Using two instructors 
resulted from the inability to secure either of the leaders for 
the full six weeks. However, this procedure has many advan- 
tages among which is the utilization of the leadership and phi- 
losophies of more than one instructor. 

The faculty enrollees in the course were selected by the Aca- 
demic Deans in cooperation with the Chairman of the Counsel- 
ing and Testing Committee. Each instructor selected was in- 
terviewed by his Dean to determine whether he desired to 
participate in the course, and enrollment was on a voluntary 
basis. Two sections per day were organized in order that conflicts 
with teaching schedules might be prevented. 

The first two meetings were utilized by Dr. Super as a con- 
ference in developing the topics to be discussed in the course. 
The problems as suggested by the members were classified into 
four areas, (i) Administrative, (a) Establishing and Handling 
a Counseling Relationship, (3) Problems of Diagnosis and, (4) 
Problems of Counseling and Orientation. 

Most of the topics were discussed by the group with the 
leader supplying pertinent points and summarizing conclusions. 
In many instances, however, all information was supplied by 
the leaders. 

The majority of the enrollees in this course were faculty mem- 
bers who were employed on a nine-months basis with provision 
for additional salary for teaching in the summer session. Twelve 
semester hours were considered as a full teaching load, which 
was necessary for full salary during the summer. If an instruc- 
tor did not have a full teaching schedule, the enrollment in the 
counseling course was considered to be 1 5 per cent of a full 
load. Thus an instructor who was assigned only 75 per cent of 
teaching time could draw full salary for the summer through 
participation in the counselor course. For those who had a full 
teaching load or were employed on a 12 months basis a small 
stipend was given each individual who enrolled and participated 
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m the i<tiirv Approximately »jc> per cent of the group were 
trai ?mjj .1 full m hrduh* or were nn a 1 2 months basis, and, there- 
fore. drew the additional salary. This plan resulted in full at- 
tendant r at all meet in. :* of the course. It was generally under- 
*(<**1 that thr cnrollcc* >n the course would l>e expected to 
avainic * minxclint: rexp-oUMbibrie's during the 1948-49 session of 
the t*o}Jei!e. The group served as a nucleus for obtaining coun- 
selors for the * k, brc-dutim who enrolled in September, 1948, 
The summer t nurse has been followed by holding monthly 
meeting'* of the counselors to exchange experiences and to dis- 
vii*s iwmible vdutiona tr* the problems encountered during the 
year. 

This cxi’eriinrnt in developing Faculty Counselors and secur- 
ing faculty cooperation in the student personnel program has 
proved to He successful and worthwhile in this particular Col- 
lege. House instructors who enrolled in the course were doubtful 
as to its outcome. Others who entered were not entirely in 
sympathy with the student personnel point of view, yet as 
knowledge was obtained relative to the purposes and techniques 
of counseling, these individuals apparently became completely 
sympathetic towards the work. The effectiveness of the whole 
program here leads to the conclusion thar the summer course 
was entirely successful. Consequently, this procedure will be 
followed during the summer of 1949. Two groups will be or- 
ganised. one, an advanced class for those who participated in 
the 194H course, and the other for instructors who have been 
employed during the year or were not enrolled in the previous 
course. 

Another value derived from the experiment in 1948 has been 
the appointment of a Student Personnel Committee to study 
and develop a comprehensive student personnel program to in- 
clude all phases of student life exclusive of the academic and 
business phases. The Faculty is receptive to the student per- 
sonnel organization since experience with the present counsel- 
ing program has demonstrated a real need for coordinating all 
areas of student activities. The organization of a student per- 
sonnel program has been made much easier as a result of the 
training course for Faculty Counselors which pointed out the 
functions and values to be derived from thiB program. 



THE FACULTY ADVISORY PROGRAM OF THE OHIO 
STATE UNIVERSITY COLLEGE OF EDUCATION 

L L LOVE 

Junior Dean and Coordinator of Student Personnel, College of Education, 

Ohio State University 

We have about 3200 undergraduates in the College of Edu- 
cation of the Ohio State University. Each of them has a faculty 
adviser. We believe that, on the whole, the faculty advisory 
program is successful. I shall attempt to tell you how the pro- 
gram operates, something of how it came into being and the 
problems we met in developing it, some of the procedures we 
follow which we think help make it work, and some of the yet 
unsolved problems. 

A few words of explanation of the setting in which we operate 
seem necessary before discussing the advisory program itself. 
We accept beginning freshmen in the College of Education and 
the University is required by law to accept graduates of Ohio 
Class A High Schools. Selection in the College is a continuous 
process, about which a little more will be said later. Of course, 
we get large numbers of transfer students. I shall not discuss 
the early advisory program for them. We have reasonably ade- 
quate ways of getting them “on the track.” 

One further point must be mentioned. The Junior Dean and 
Coordinator of Student Personnel heads up the total personnel 
program of the College, including of course, the faculty ad- 
visory program. He is also the liaison person with all the other 
personnel services of the University, and the College uses them 
extensively. The faculty advisory program is difficult to isolate 
for descriptive purposes because it is not a fifth-wheel organi- 
zation. It is closely knit into the total personnel program 
Moreover, it should be clear a little later that we find it im- 
possible at many points to draw a dividing line between per- 
sonnel and instruction. We want it that way, even though it is 
difficult to make a diagrammatic chart of the personnel pro- 
gram of the College. 
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Each freshman student is assigned to a faculty adviser as 
won as he enters the Collette. The adviser has this student and 
5 K to tun others in the required five-credit hour orientation 
course. F'nr thiv phase of the program, at least, there is no p ro (). 
lent of advisory work being an “extra. *' This course and its 
attendant responsibilities count full value on academic load, ■ 
Wr attempt. not always sneers -dully, to give a staff member 
rtr»j more than two of these group-, Jrs any one year in order to 
prevent too heavy a loud rd advisees. 

Students are assigned both homogeneously and heterogene- 
ously. In what we call "secondary academies" we mix English, 
Science, Mathematics, I anguage, and Social Studies majors 
indiscriminately. We have Itcen over ail the arguments, pro 
and con. for each plan. To us, the evidence is not clear-cut, one 
way or the other. In our situation there are circumstances 
which verm to make mx ec-ary the use ofl*oth plans. They work 
equally well. The theoretical objections to homogeneous group- 
ing are not borne out in practice. 

In this course w ith about 20 student* the adviser follows up 
the Freshman Week Program with the usual things expected 
of an orientation course, such as study skills at the University 
level, orientation to the University, social living, extra-cur- 
rkular activities, and the like. Intensive attention is given to 
orientation to teaching what it is like, supply and demand, 
desirable teaching combinations, etc. 

'Fhe very heart of the course, however, is planning in terms of 
the things to tome. Wc have a continuous selection program 
with certain rather formal check points, the first of which is 
admission to junior Standing. Students must demonstrate cer- 
tain comfietencres at chat time. To us it makes sense that stu- 
dents know where they stand on these competencies in their 
first quarter in the College. 

They must have adequate classroom speaking voices, so they 
are checked cm voice quality and speech usage. They must be 
able to express themselves well enough in writing so that they 
will not later disgrace themselves before a class, so their writing 
skills are observed. They must have certain kinds of field ex- 
periences, so what they have had before coming to the Univer- 
sity is evaluated. They must have a reasonable knowledge of 
current affairs so they take a Current Affairs 'Test. They must 
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have a background of general information, so they take the 
Cooperative General Culture 'test. They must come up to cer- 
tain standards of physical and mental health, and the Uni- 
versity Health Service checks on these points as a part of the 
entrance physical examination. All this, with the exception of 
much of the health information, as well as other diagnostic 
information, goes to the adviser. It becomes his very important 
responsibility to help the student to gradually become ready 
for the formal mid-point check-up. Various special University 
facilities and personnel are available to the advisers in this 
work. 

It is obvious, of course, that a considerable number of stu- 
dents enter the College who should never have come to the 
University in the first place or who should be in some other 
field than Education. Our advisers are giving more and more 
attention to guiding such students out of the College in a con- 
structive fashion The Occupational Opportunities Service, with 
its testing and counselling, is an invaluable aid here. We are 
having some success at this point but there is still much to be 
desired. 

One of the most important tasks of the adviser in this be- 
ginning course is to rate the student on a comprehensive scale 
set up in terms of the objectives of the College, the same form 
that is used later for Junior Standing. Frequently adviser and 
student do this job together. Working out the rating in this 
way does much to aid the student in self-understanding. The 
student’s cumulative record folder starts in this course and 
follows him with any change in advisers. 

This program is planned and directed by a College-wide, 
not departmental, committee. Nothing the College has ever 
done has been more continuously and carefully evaluated. There 
are several theses and dissertations on various aspects of the 
program. One important point cannot be over-stressed. That is 
the weekly meetings of advisers while the course is in progress. 
Without this in-service training we do not seehowwe could even 
remotely approach what we have done. 

Thus far we have the student through his first quarter. If 
we are going to get him a degree within the next few minutes, 
we are going to have to accelerate rather than enrich him. 

I mentioned the special fields, such as physical education, 



+ jtfj FtiVc'^tinKM. akd rsVc untOrac-At, measurement 


industrial arts and music. Students in these areas stay with the 
same adviser until they leave the f mvcrsity, or shift to some 
e*»h*rr area The secondary academics stay with their first ad- 
viser four f *r five quarters, then shift to the instructors of the 
two quarter sequence in Principles of Secondary Education for 
two quarters. At the beginning of the Junior Year, they shift 
to the College staff member who will teach their special methods 
courses and supervise their student teaching. Providing con- 
nntmy m advisers fur this group has been our greatest single 
problem and it is not yet completely solved. 

Fatuity advisers are very important persons in the College, 
I can hut mention some of their responsibilities in support of 


tius ( pj,i ricr’s schedule must be personally approved by 

sfir adviser Iwfore it will he accepted by the College 
Qtittc. 

2. Any schedule change other than of a routine nature must 
be first approved by the adviser. , 

i So student is admit ted to Junior Standing unless he is 
* * uiven « *ati sectary rating by hi* Adviser on a specially 
deigned scale. There is a court of appeal winch has been 


S 


used bur once. , . . , , . , 

No student is admitted to student teaching unless he is 

approved by his adviser. 

Student petitions for rcadrmssion or exceptions to re- 
quirements must carry the recommendation of the adviser, 
ft. Advisers nominate the student membera of faculty cc om- 
mittees, make recommendations for scholarships and the 

7 . Advisers, through their various organizations, "commend 
changes in College policy, procedures, and rcquirmen^ 
The most important organization from he 
making the advisory program work » what ■ a 

mittee of Coordinating Advisers. A Coord.natmg Advi 
representative of the advisers >n an area, such “ , 

cation , elementary, industna ^'^^jS’Dean afid 
College personnel officers, and chaired by tn J , They 

S»Xw ol SBKknc Personnel, mec« 
take up anything and everything related to *- A( ?vbers 

gram and how to make it better. The Coordinati g 
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are a sort of unofficial cabinet for the Junior Dean. They them- 
selves have grown in advisory ability as a result of these meet- 
ings, and their convictions as to the value of the program have 
had marked influence on faculty opinion One of their impor- 
tant jobs is in-service training of the other advisers in their 
areas. 

There are a number of rather specific factors w'hich have con- 
tributed to whatever success this program has achieved: 

1. We have given advisers important jobs to do. 

2. We have attempted to reduce irritating petty details and 
paper work to a minimum. 

3. We have played up the importance of advisers. 

4. We have in-service training programs. 

5. We recognize advisory work as part of the academic load. 

6. We have been able to get one or two promotions pri- 
marily on the basis of advisory ability 

7. The College personnel officers go to almost any lengths to 
be of service to advisers. 

8. Almost to a man, the members of the faculty recognize 
that the student is the center of the educational process. 

9. The results of the advisory program are clearly demon- 
strable. 

Getting to where we are today has meant ten years of the 
hardest kind of work. We still have some very real problems I 
can see and probably some I don’t see. Among them are: 

1. Some advisers have too many advisees. 

1 , Some advisers are not as competent as they should be. 

3. We have trouble at some points in providing the proper 
continuity of advisory service. 

4 Some advisers do not get sufficient credit on their loads 
for their advisory work. They are therefore either over- 
worked or do not give sufficient attention to their advisory 
responsibilities . 

For budgetary reasons we have not been able to staff 
the beginning orientation course completely in accord with 
principles approved by the college. 

' In closing, I want to point out that the faculty advisory pro- 
gram is but a part, though perhaps the most important part, 
of the College personnel program. I have tried to isolate it as 
best I can and describe it for you. 



SEC, THING FACn.TY COOPERATION IN THE 
SIT DENT PERSONNEL PROGRAM 

jtSSIK KIlt'LMAN 

A*wn!f Or nit f»l MiJiWt, 1‘wvrfuJT **l California at Le» Angeles 

Sti'MXi pmsunnd programs .ire still relatively new as or- 
ganized. dynamic parts of a Eniversity educational program. 
They bring to a campus persons trained in a profession with 
which many faculty members arc not familiar-* one which many 
of them do not regard as a profession. After all, have not stu- 
dents for many generations managed to get along well without 
such professional assistance r Have we not as faculty people 
taken < are of the needs of students without professional assist- 
ance? Tins is the prevailing attitude on many campuses today, 
And those «f us who believe that these programs have great 
service to offer to both students and faculty also know that our 
efforts will not be successful unless \vc secure faculty under- 
standing and utoperation. 

If we took ar the problem from a faculty standpoint and rec- 
ognize the dements in the situation to which they have resist- 
ance wc will understand that, were the situation reversed, we 
should probably feel the same way because we are human and 
because wc have certain insecurities. If for long we have been 
giving assistance ami advice to students and feet that we have 
done it well and if we find suddenly that someone else thinks 
it should be done on a professional basis, and if our own r61e 
is not made clear, wc should be likely to fed insecure and feel 
that our vested interests were being threatened. The fact can- 
not lie disputed that a teacher knows a student (with whom he 
takes the trouble to get acquainted) in a different way than 4 
counselor does and that he sometimes has a clearer idea of how 
the student functions than does a person who does not see the 
student in action. Suddenly the faculty member may feel that 
he or she no longer has any part to play in the guidance of the 
student-even no right to give advice, 
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Unhappily, this feeling sometimes has an unfortunate result 
on the attitude of the professional counselor and the persons 
responsible for the student personnel program. Too often they 
feel that they are not academically respectable and take on 
certain of the characteristics of minority groups. Such behavior 
is fatal to the success of any student personnel program. 

Often, too, student personnel programs have been instigated 
Without a clear-cut statement of purpose, without a carefully 
thought-through plan in terms of the culture of a particular 
campus, without adequate discussion and consultation with 
faculty members who know well the temper of the institution 
In trying to make ourselves fully adequate professionally we 
have sometimes made the error of taking ourselves and our 
plans off to an “administrative corner” and emerging with a 
full-blown plan for the campus Without meaning to do so we 
have surrounded the whole area of student services with an air 
of mystery As a result we have made ourselves even more sus- 
pect from the standpoint of academic tradition than is usually 
the case of one who represents something “new” in the academic 
world 

If we are to succeed as professional people with a professional 
program we must be aware from the beginning of what faculty 
attitude may be, of the necessity for changing it, and of the 
fact that securing faculty cooperation is a matter of education 
— groups and individuals — of making them cognizant of what 
goes on, of what the aims and objectives of the program are, 
and of their own part in it 

Where then do we start? Most of us think best in concrete 
terms and in the context of our own situations. I am, therefore, 
going to describe to you the attempts which are being made in 
our situation at U. C. L. A. to accomplish this all-important 
task — and which we believe are being reasonably successful. 

First of all, the problem of academic respectability was con- 
sidered. The two persons directly responsible for the adminis- 
tration of the program both have academic rank in the Depart- 
ment of Psychology Both, by their own request, have teaching 
assignments. The Director of the Counseling Center is an 
Associate Professor in Educational Psychology, the Assistant 
Dean is a Lecturer in Physical Education, the Foreign Student 
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Advisor is an Awaiatc Professor of English. All are prof®.,, 
atonal ly qualified for the jobs they arc doing and all have been 
approved by commuter* as acceptable members of their respec- 
tive academic departments. 

NVxt came the drafting of a charter under which the new, 
program would operate It included not only major objectives 
hut' also job descriptions of the principal officers and a state, 
went tn the effect that “ Wcausc the Uni versify Student Person 
nrl Program <uit acorn so many lines and involves working, 
relationship', of sev eral types with all colleges and most depart- 
mvn tw, an .irlvr.ory committee is recommended." The Provost, 
was asked to appoint this committee to include representatives 
from the .tilnunsstration of all colleges and schools, from the 
Departments of Psychology, Sociology, and Physical Educa- 
tirm, from the Admissions and Registrars Office, from the 
Estetvvjon Service and front the Dean of Students Office where 
the chairmanship should reside. 

The major function of this committee is to aid in the formu- 
lation of alt University policy regarding student personnel work, 
xn advise the office of the Dean of Students in matters which 
affect the University generally, and to aid in the coordination 
of service* among and between the major divisions of the Uni- 
versity. 'Phis committee meets about four times during the 
year. Its ntemlters are consulted individually many times. To 
date its major function has been to discuss which aspects of 
student personnel belong appropriately to the colleges, which 
to the departments, and which to the all -University Student 
Personnel Program. Members of the committee were given an 
opportunity to express themselves in writing on the matter and 
then to discuss it fully in an open meeting. Another meeting 
will be devoted to this topic and then consideration will 
given to an evaluation of service rendered to date, and to what 
the future functions of the committee should be. 

In this way the organization and functioning of the studen 
personnel program has been made a part of the thin ***8® 
major administrative offices of the University and of the U» 
man of the Departments most directly concerned. Not cmy 
have mutual problems been ironed out and mforma 10 
changed but the persons upon whom the responsible y 
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educational program of the University rests have been given 
an opportunity to become acquainted professionally, and to 
some extent personally, with the new program and the persons 
responsible for it. 

For the Counseling Center, a service department within the 
jurisdiction of the Dean of Students Office, a similar plan has 
been followed through, although on a somewhat smaller scale 
To return for a moment to the so-called “charter,” all func- 
tions of the program were described and all services which it 
was prepared to render were listed This document was put in 
the hands of both the advisory committee and the Counseling 
Center committee. For example, in describing the scope of the 
program for the Counseling Center the following items which 
pertain particularly to the faculty were listed- 

I. To supply professional counseling services to both stu- 
dents with complex educational, vocational, social-emo- 
tional problems and personal problems within the normal 
range 

II. To cooperate with University faculty members and ad- 
ministrators in helping students to solve their problems. 

III. To undertake case studies and collect information about 
students in cooperation with other campus personnel 
agencies in order to determine student needs. 

IV. To provide a central file of pertinent information about 
students. 

V To provide services, such as test scoring and aid in 
constructing and validating course examinations, for 
those University faculty members, departments, and col- 
leges which request them. 

VI. To conduct special group test programs for departments 
or colleges, upon request. 

VII. To conduct, and cooperate in, University service re- 
search considered to be of value to students and faculty. 

VIII. To cooperate with other University departments and 
colleges in such community services and research as may 
be deemed appropriate. 

IX To participate in the training of graduate students en- 
rolled in the various graduate departments of the Uni- 
versity which train personnel workers. 

X. To conduct in-service training programs in various as- 
pects of student personnel work for interested faculty 
members. 

This statement of purpose was made explicit because of a be- 
lief that any new major unit on a campus should be carefully 
integrated with the existing academic and administrative struc- 



jUU-C ATtOK \t AS!) 1'SVt KOl.CHiJCA (. MEASUREMENT 

turc. And v» that all members of the University staff might 
lie made aware of existing services from which they could 
brnrfit 

A further step in securing cooperation has been the institution 
of" an in-service training program for both Fall and Spring 
Semesters. These meetings have been held once a week. During 
the hall Semester there was at! average at tendance of between 
fy •• and ?■-" persons representing all i nllege and administrative 
otfucs and many atademic departments. The fall program was 
concerned with the sharing of information of existing student 
services. Ail divisions offering such services participate in these 
presentations. One faculty member said, "1 have been on the 
campus 54 years and 1 did not know that many of these services 
were available " In the Spring Term, there have been three 
seminars one on ’"Self-Analysis," one on “Studying the In- 
dividual," and one on "Campus and Community Resources in 
the Adjustment of Individuals." Again there is interested par- 
ticipation from a wide variety of departments and services. The 
stated objectives of both terms of work arc; 

t, To acquire a Iwttrr understanding of our student body as 
a whole. 

2. To at mure information al«*ut what services are available 
to students and how they mav be used. 

.5. To develop a point of view .d*oiit our own jobs and about 
dir place of these jobs in the rota! personnel program. 

4. To .0 quire a knowledge of the skills and techniques which 
are useable in particular job situations. _ 

<. To gain an understanding of our own limitations as coun- 
selors fwe .til have them). 

(>. To provide an opportunity for an exchange of ideas in the 
development of a sound student personnel program on the 
Tats Angeles campus. 

For the remainder of this year only one additional step is 
contemplated -the preparation of an Annual Report which is 
both descriptive and quantitative and which will be presented 
to the Academic .Senate as a summary of the first year of opera- 
tion. This, we believe, is an unusual procedure in that such 
reports ordinarily go to the President of a University but not 
usually to the Faculty, In this instance it will not only go to, 
the President and the Faculty, but also to the student body 
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officers on the campus. At least, no one will be able to say that 
he has not had the opportunity to know what we have done 
and what we are planning to do 

This paper will not attempt to enumerate all of the commit- 
tees, administrative and academic, on which personnel staff 
members have served, but they have made it possible to widen 
acquaintance in the University, and to give service as partici- 
pating members of the University Faculty. 

All of these steps have been taken in the belief that the first 
step in securing faculty cooperation is to acquaint them fully 
with what we are doing in language that is understandable from 
a lay point of view Our first concern has been the interchange 
of information and clearance of plans where functions have 
belonged to some other department or service. There has been 
a great deal of discussion on this latter, that is, where certain 
functions can best be performed and how such service can be 
conducted. It will continue to be a major topic for a long time 
to come 

Finally, we believe that mutual trust and understanding are 
built on acquaintance, friendly relationships and service— we 
have, therefore, been very busy making ourselves known as 
persons, as well as trying to make the professional services we 
offer a part of the thinking of every staff member in the Uni- 
versity. 



SEIVRINC; COOPERATION OF THF. FACULTY 
IN 'IT IK PERSONNEL PROGRAM 

MAL'KICE I) WOOLF 
rtr*H rtf 5lt»d«tO, Kuxt Slale Co4(cge 

Swusuko the cooperation of the Faculty is a complicated 
prm-evs The starting point of the process may be unrecogni- 
zable as such. It may begin with a social explosion among the 
students, such as the declaration of an illegal holiday, a mob 
invasion of the classroom, barricading the campus entrances, 
throwing a classmate through a window, or demolishing the 
furniture in a local tavern. 

These arc evidences of underlying currents of dissatisfaction 
and provoke the question, "Is the college satisfying the needs 
of the students?" 

A study in one midwest college revealed that only 37 pet 
cent of the freshmen completed a four-year degree. Twenty- 
six per cent of ail its students were not making progress toward 
a degree. Less than half of this number could blame low 
ability. 

Drop outs, failures, marginal achievers and social explosions 
are evidences which help to convince a faculty that prohkm 
exist and provide them with the necessary motivation to work 
on a solution by faculty committees. Thus it is possiblcfor faculty 
members to discover for themselves the urgent needs and prob; 
lent s of the school. 

At the risk of being obvious, let me point out that the laws 
of learning operate as well with faculty members as with stur 
dents. The Dean of one of our scientific-technical schools at 
Kansas State College decided he would find out for himself 
whether there was anything to this new testing program. He 
made a study and announced with pride and some astonishment 
that achievement in his school could he predicted on the basis of 
the tests. Having discovered this significant fact for himself 
he believed it. He had learned it only after personal exploration 

4*8 
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and it was as new to Kim as if he had not heard me say so re- 
peatedly 

Participation by the Faculty in planning a personnel program 
and in making a decision to establish such a program should be 
invited. 

Suppose the Faculty of X College has studied and approved 
a plan for faculty advisement of freshmen, to be supplemented 
by clinical testing and counseling by a staff of trained person- 
nel workers. 

Assuming that Advisers have been selected by the Deans 
of the Schools or Colleges, how will the Personnel Director 
train the Advisers? 

Advisers in one college asked for training sessions led by mem- 
bers of the clinical staff. Case studies were presented by clini- 
cians and selected advisers who distributed to the audience 
mimeographed copies of case data to be consulted as the cases 
were discussed. A handbook for advisers was prepared by 
members of the personnel staff and used as a basis for discus- 
sion. 

You skeptics in the audience are saying to yourselves that 
tired, over-loaded teachers will rebel against these meetings. I 
recently assisted with a training course for the faculty of a 
large high school The final session of two hours closed at six 
p.m These tired, hungry, red-eyed teachers had wrestled with 
wriggling adolescents and breathed chalk-dust for five hours 
before the class convened, and yet they sat in their chairs and 
asked to continue the discussion. 

Newly developed group techniques make these faculty meet- 
ings most productive. Following a report on some aspect of the 
proposed program, the leader divides every other row into 
groups of six who are asked to turn around and talk to the six 
people behind them on the subject just introduced A spokesman 
is elected for each group to report their conclusions to the 
general meeting. A short conference in small groups followed 
by reports gives an opportunity for widespread participation. 

In actual practice this device stimulates much thought and 
expression of opinion. Observers note a quickening of interest 
and participation, increasingly efficient use of time, and no- 
ticeable progress toward goals, each time the system is used. 
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One of file value** of such a meeting is that members of the 
audience have an opportunity to express positive or negative 
feehnKS toward the propmrd program. After letting of steam 
the nhfttnu liomst often discovers favorable aspects of the pro! 
grant. 

Faett, alone, will not insure the cooperation of the /acuity, If 
the personnel worker takes a realistic view of his task, he knows 
that flic major obstacles m the success of a comprehensive 
program arc the emotional problems of resistance, fear, and 
hostility among the faculty. Educators are subject to all the 
peculiarities of the human race, ami like other human beings, 
arc inclined to resist change ami to regard a new system as a 
threat to personal and institutional security. Charles Kettering 1 , 
Director of General Motors Corporation, says whenever he 
hears a speaker propose a change in the traditional method of 
handling a situation, he can write the committee’s adverse 
report without hearing the. rest of the meeting. People are in- 
clined to He suspicious* of change. 

Indeed, it sometimes appears that educators are even more 
conservative than the general population. Nathaniel Cantor, 1 
in his book. Dynamics of Learning, says. “Education is the 
handmaid to reaction,’" In any case, the personnel worker can 
expect to hear these statements, firmly reiterated, "We have 
never dune this before,” or "We have been doing it this way 
for ;}« years.". . . with a finality of tone which is supposed to 
close the subject. 

The faculty member who is already engaged in some variety 
of personnel work may be especially skeptical of one whom he 
regards as an interloper. Others view the whole idea as nonsense 
and resent the added responsibility. The pioneer personnel 
worker can expect rebuffs. He may find himself in the shoes 
of the battered little boy who had been advised to give up 
roller skating. He replied, *' I got these skates to learn with, 
tint to give up with.*' 

We have been talking about resolving resistance by employing 
democratic and psychological principles: permitting the faculty 
a part in evolving and operating a personnel plan, providing 

1 In * speech deliver®! »i KattMt State Collette, March 30 1949 - 

* ttynemici tH laetning, Buffalo: ffoater and Stewart, 15140, pp. I~J 3 . 
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for free expression of negative as well as positive attitudes, and 
applying the laws of learning to the faculty. 

Now let us look at administrative controls which help to 
produce faculty cooperation, Aministrative interest in the pro- 
gram is salutory. 

I have observed, with respect, the magic effect of a simple 
statement of support by the administration. I am reminded of 
an incident which applies to the problem. An unhappy looking 
wedding guest was asked if he had kissed the bride He replied 
reminiscently, “Not recently'” . . . Following an administrative 
directive you will always observe a certain number of hitherto 
reluctant followers getting in line to kiss the bride. 

Arranging for contacts between students and their advisers 
is an adminstrative problem. The administration can make it 
easy for the faculty to cooperate. Both faculty and students may 
be inspired with the best of intentions, but if part of the an- 
nouncements get lost in the college post office, or the adviser’s 
office is in some remote corner of the campus, or if he prepares 
for a conference and his advisees do not show up, enthusiasm 
is considerably dampened. Students who find it difficult to 
think of a faculty member as a friendly, helpful adviser may 
hesitate to make the contact. I recall a high-school student- 
president who expressed a characteristic attitude when he began 
an assembly speech with these words, “Faculty members! And 
Friends /” 

Enrollment procedures can help or hinder the program. If 
the freshman is enrolled by his adviser, the contact is assured ; 
the use of test results and other data in enrollment is made pos- 
sible; and the accurate placement of students in curricula is 
facilitated. The enrollment of upperclass students at the close 
of the previous semester clears the way for the adviser to spend 
more time with the freshmen 

The practice of issuing grades to the students through their 
advisers is effective. The student has an opportunity to eval- 
uate his progress with his adviser and to secure his help in mak- 
ing future plans. 

A special advising day set aside in the schedule facilitates 
the advising program. If appointments are left to chance or 
scheduled for holidays, the number of contacts will be sketchy. 



4% I 


f tltlCA rtOMAU «Mt> psyCHOUWICAt MEASUREMENT 


The admnmtrativc set-up affects the number of referrals 
by faculty nwmbets to the clinical counselor. Automatic re- 
ferral of ffss. spline cases ami failures will get a large number 
n{ problem races to the clinic. Probably no student should be 
permitted to appear before the reinstatement committee until 
he has seen a counselor In order to keep relations harmonious 
I set ween tounscW and cosnmittec, the counselor should send 
a prompt report on any student referred to him by the com- 
mittee 

A reduced ai ademie load or additional pay for the adviser 
are admimrstramc practices sometimes employed. They pro-" 
vide an incentive and give the administration the advantage 
whenev er it ss desirable to remove an adviser. A bonus of fifty 
dollars each semester is given each adviser in a certain small 
liberal arts college. Pule** he docs a satisfactory job of advising 
he knows he will lone his advisees and his bonus. 

Because of the demands made on the college President and 
his staff, he is obliged to depend on the Director of Student 
Personnel to keep him informed as to the progress and needs 
of the program This is a very important function of the head 
of the personnel program, and the Personnel Director should 
take the wtitatiat in establishing communication with the ad- 
ministration , . 

The success of the program also depends on the efficiency 
of the personnel staff. The mechanics of preparing and issuing 
freshman folders should be carefully worked out for the s «*, 
<*#.«»<* hi tit Wet'**. This involves the planning of freshman 
orientation to permit prompt scoring and recording of test 
results before the date of registration. 

A system of communication between faculty advisers and 
the personnel staff is absolutely essential Any adviser who 

refers a student for clinical counselmg should receive areport 

of the diagnosis of the problem and the results of counseling. 

Now Ictus say that the plan is working. The adrrunisttatwt 
arrangements are favorable; the freshmen ^ave been tes^, 
adviJd and enrolled. The advisers have recorded the. mter 
views and returned thdr folders to the counseling bureau. 

The problem of resistance, though modified, is still with us. 
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The role of the adviser must be built up. The conscientious 
adviser who has already grasped the purpose of the program 
should receive recognition. The adviser who has begun to apply 
his knowedge of test interpretation and interviewing in actual 
situations should have an opportunity to ask questions and 
to describe his experiences. The adviser who is disgusted and 
disillusioned should be given an opportunity to present his 
point of view and to get rid of his aggressions. 

A meeting following the first advising conference is usually 
very productive. Breaking the audience down into small groups 
is essential for fullest participation 

This is the point (one of them), where the director of the 
program will be in despair over the attitudes of some advisers. 
On the other hand, he will be agreeably surprised at the sen- 
sitivity and enthusiasm of many of the untrained faculty mem- 
bers. 

Direct contacts between the Personnel Director and the in- 
dividual adviser are profitable. Members of the personnel staff 
should assist the director in interviewing individually as many 
advisers as possible. 

An emphasis on gains and successes will produce more learn- 
ing among the advisers than criticism of their mistakes. A bee- 
keeper replied to a complaining visitor who had been stung, 
“Just show me the bee and I will have it punished.” . .The 
productive members of the apiary are easy to identify, and 
they should be recognized. (After all, material rewards will not 
be abundant.) 

The adviser should be consulted whenever any of his ad- 
visees are involved with the reinstatement board, discipline 
committee, etc. 

The number of advising contacts and those which are par- 
ticularly noteworthy should be reported to the deans of the 
various schools. Check-up studies should be made on whether 
or not failures, curriculum changes, discipline problems and 
drop-outs are reduced. Whenever results begin to show up, 
they should be reported to the adviser and the administration. 
Seventy per cent of the 1947 freshmen at Kansas State College 
who had seen their advisers reported they had received help. 
Eighty per cent reported they felt their advisers wanted to 
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help them * Reports of this nature stimulate interest among 
the faculty B 

Cooperation int Teases w hen the adviser observes that the 
personnel system is doing something Tor him: reducing the 
number *»f shifts in curriculum by students, eliminating disin- 
terested students, and routing in him students who are inter- 
ested in his sa n field nf subject matter. When the adviser feels 
the satisfac turn »l helping a stmlrnt through counseling, his in- 
tcfcM in his role will grow. 

In other words, securing the cooperation of the faculty is a 
continuing process The advising program can break down in the 
relationship between the adviser and the head of the program. 
It is similar to the management -worker relationship . . . and the 
finding® of KwshSishcrgrr and Dickson* apply as well in the 
advising program as they do in the industrial plant. Their con- 
clusions were that social and emotional satisfactions are at least 
as important to the worker as pay, hours and working condi- 
tions. The athiicr, hkc the worker, must know his role and how 
he fits into the picture. He must fed that he is making a con- 
tribution and that it is recognised. 

Let us review the steps in securing the cooperation of the 
faculty; 

j„ Involve the faculty in a study of student problems and 
permit them to participate in the development of a personnel 
plan 

а. Chntwc a personnel staff 

j. Recognize the emotional problems of resistance, hostility, 
and fear among the faculty 

4. Set up administrative procedures which will motivate the 
faculty and permit the system to work 

5. Choose the advisers 

б, Begin the training program for faculty advisers 

7. Evaluate the adviser and define his role 

H. Keep him informed 

9. Continue the use nf personnel methods with faculty ad- 
visers 


•Cbsmtselmt Bureau Sottly, Kansas Stale College. „ . 

• IWitilUtcrarr. F, J. and Dickson, W. J . A larwgemerit end the ff arker . Cambridge. 
Harvard I'niv Pres*, lajj 



SECURING COOPERATION OF FACULTY' 


495 


The basic concepts underlying this approach are: 

1 . The individual faculty member has a right to help make a 
decision which affects his work and the welfare of the college. 

2. Feelings of resentment, hostility and fear among faculty 
members are inevitable and it is the responsibility of the per- 
sonnel director to try to resolve them 

3. Widespread participation and ego-involvement will help 
in securing the acceptance of the program. 

4. Motivations within the group can be manipulated to 
produce faster and more permanent learnings. 

5. Personnel procedures can work with faculty members. 

The skeptics among you will say that these proposals are 

impractical and idealistic. I must confess that if you were to 
visit our system, you might find some imperfections. But then 
it is entirely possible that we learned some things while estab- 
lishing a program which we can pass on to you. 

Possibly it will reassure you to know that these techniques 
have already been put into practice by some innocent souls 
who were not aware that they were impossible. 

I call your attention to the New York engineers who had de- 
cided that a certain hydro-electric dam was impractical. While 
they were debating, beavers moved in and built a dam, 126 
feet wide and six feet high, and flooded fifteen acres. A blissful 
unawareness of the impossible is all you need. 



GROUP TECHNIQUES IN THE GUIDANCE PROGRAM 

IKINALI) K. SUPER 

PcoIrwW til Ktiucatinh, Teacher,. College, CoKiinliin University 

This paper is an attempt to examine group guidance, on the 
part of one who is not a specialist in that area, to view group 
guidance in some perspective, to rationalize our thinking about 
its techniques, and to assess its contribution to and its place 
in the total program of guidance services. The extremely di- 
verse and incohesive literature was difficult to assimilate and 
to synthesize. What follows is therefore definitely one man’s 
attempt to organize a chaotic field; it is sure to prove incom- 
plete and inadequate in many ways, 

A Bird's Eye View of Group '■Techniques 

Group guidance methods can be classified under two headings 
according to their purpose: as orientation activities, and as 
therapeutic activities. They can be classified also according to 
the principal method used: as activity methods and as discussion 
methods. The discussion which follows focuses first on the pur- 
pose, then on the method. 

Orientation.— The purpose of orientation is dual: it may 
be factual , conducted in order to disseminate information 
presumably needed by the participants, or it may be altitudinal, 
designed to inculcate or develop attitudes which facilitate self- 
orientation. Or it may, of course, be designed to do both of 
these things. 

Factual orientation, which presumably helps the individual 
to adjust when there is little likelihood of emotional involve- 
ment, should be useful in a guidance program when carried 
on before the information which is to be imparted has acquired 
appreciable emotional significance. Thus, orientation to un- 
skilled and semi-skilled occupations, which tend to be looked 
down on after financial and social status values become attached 
to them in the eyes of children, might best take place in the 
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elementary school. At that age they would be judged less 
by monetary and prestige returns, and more by the intrinsic 
nature of the activity, strength, speed, skill, tools, and the 
social contribution of the worker would be among the deter- 
minants of which the child was aware. At this stage of his 
development, he would be able to take in facts which would 
serve as the basis for a more tolerant and accepting attitude 
toward unskilled and semi-skilled work as he grew older. 

This illustration of the importance of timing in factual orien- 
tation has implications for the methods to be used in the dis- 
semination of information. As Jager has often pointed out 
in criticizing the use of the term “group guidance,” the dissemina- 
tion of information, factual orientation, is nothing other than 
instruction And if the instruction, to be helpful in promoting 
adjustment, must come at just the right time in a child’s life, 
then it will be difficult routinely to provide specific group 
guidance activities of the factual orientation type at just the 
right time for all pupils. This hypothesis seems to be borne 
out by the experience of many teachers of orientation and 
occupations courses in junior high schools, who have found 
their pupils unready to participate and uninterested in the 
courses; it suggests that much of the needed factual orientation, 
much of the instruction in educational and vocational oppor- 
tunities, should be provided in connection with other aspects 
of the educational program. The greater flexibility of orienta- 
tion activities and discussions interwoven with other courses 
and with extracurricular activities should make these superior 
to special orientation courses. 

Factual orientation or instruction can be carried out both 
in discussion and in activities. Most instruction has relied 
on discussion, whether the discussion is dominated by the 
teacher’s presentation of prepared material or by the pupils’ 
reports of their observations and reading. Familiar illustrations 
of this method of group guidance are the texts by Chapman, 
by Brewer and Landy, in which the world of work and the 
principles of occupational choice are surveyed. Parsons used 
this method with groups of young men back in the early days 
of vocational guidance; we use it today in most occupations 
courses and in many career day and assembly programs. 
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The use of activities as a means of disseminating information 
whether educational, occupational, or otherwise, seems to me to 
be more promising than discussion. One of the better illus- 
trations of the use of this technique is the Occupational Labora- 
tory Method developed in the General College of the University 
of Minnesota, in which students make first-hand studies of 
occupations selected on the basis of appropriateness to the 
individual student. Hut the use of activities for the dissemina- 
tion of occupational information is not limited to the point at 
which vocational choices are being made, nor to occupational 
laboratory courses. School newspapers, aviation clubs, dramatic 
societies, and numerous other extra-curricular and leisure-time 
activities lend themselves to the dissemination of occupational 
information, make the information more functional and easier 
to assimilate than when it is encountered simply as facts about 
an occupation which may as yet have little meaning to the 
person in question. 

Attitudinal orientation can be distinguished from factual 
orientation more readily in theory than in practice, but the 
distinction should be helpful in understanding more clearly 
the principles and procedures involved in practical work. 

To be able to assimilate facts and to see their personal 
implications one must be open-minded and free from emotional 
involvement. The facts must be acceptable to the individual, 
compatible with his self-concept and with his values. If they 
are greatly at variance with what he values he will have 
difficulty reconciling them with what the experience of years 
has led him to believe. When faced with such a dilemma the 
newly ascertained facts are at first, of necessity, rejected, for 
they cannot compete with the emotionally bolstered convic- 
tions of the past. For them to become acceptable, either they 
must acquire positive emotional values of their own, or the 
antagonistic emotions which they arouse must be worked 
through in such a way as to weaken the barriers to acceptance, 
reorganize the beliefs and values of the individual, and make 
the new facts seem compatible with the revamped personality, 
It is when the facts which are to be disseminated are likely 
to be difficult of acceptance because they run counter to estab- 
lished beliefs and values that factual orientation programs are 
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likely to be inadequate, and that attitudinal orientation pro- 
cedures are needed If the emotional problem is one which in- 
volves primarily social attitudes and values, participation in 
attitudinal orientation activities or discussion may be sufficient 
to effect a change of orientation, for then the attitudes and 
values of the group are made clear and are brought to bear on 
the individual But if the values and attitudes are more per- 
sonal than social in origin and reference, orientation experiences 
may not suffice. An illustration will be helpful in making clear 
the differences between factual and attitudinal orientation. 

Let us suppose that Johnny, a boy nine or ten years of age, 
brought up in a typical middle class community, hears a dis- 
cussion of the value of a college education. The probability is 
that he will not be much involved personally himself, unless his 
parents have done an unusual amount of indoctrination. When 
he learns that one must go to college to be a lawyer or a doctor, 
but that one can be a big league baseball playei or a deep sea 
diver without such an education, he is most likely to conclude 
that college is a good thing for some folks, but a waste of time 
for others. His own college-going aspirations will remain vague. 
His attitude toward a higher education is left in a malleable 
state, thanks to his recognition of the fact that college is desir- 
able for some but unimportant for others. He can still assimilate 
facts about the advantages and disadvantages of a college edu- 
cation, provided, of course, that he is interested enough to 
attend to the facts. 

But now let us assume that this same Johnny is 17 years old, 
and that his parents have for several years been talking in terms 
of his going to a highly selective college. In an orientation 
course he is confronted with the half-suspected but not fully 
recognized fact that his grades are not up to the standard re- 
quired by that college, and that his scholastic aptitude test 
scores are so low as to make it unlikely that he could attain 
the required academic level. At this stage, and under these 
circumstances, these facts have emotional significance which 
make them difficult for him to assimilate, simple and clear 
though they are. With his and his parents’ hearts set on Siwash, 
and with his best friend already accepted there, not to be able 
to go to Siwash is an emotionally toned fact which he has diffi- 
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culty in accepting. But this is a fact which is made acceptable 
or unacceptable largely by what people think. The relevant 
values are primarily social in origin and significance: Siwash 
is tops among colleges, Johnny wants to be thought tops, and 
so Johnny wants to go to Siwash. The fact that Johnny may 
not be able to get into Siwash is discussed in the orientation 
class. As the class is attitude-conscious, and the teacher is 
aware that he is dealing with facts which may have emotional 
significance, Johnny’s disappointment becomes manifest and 
the implications of these facts for him are discussed. Several 
new facts and attitudes emerge: the class thinks that a number 
of other colleges are really about as good as Siwash, Johnny’s 
record is good enough so that he could probably be admitted 
to some of these other colleges, and several respected local 
cit"i7.ens, all of them considered tops by the class, went to these 
less selective colleges. Supported by the group’s interest in his 
plans, finding that the group considers other colleges acceptable 
and status-giving, and made newly aware of the fact that others 
have achieved status without going to Siwash, Johnny finds it 
relatively easy to scale down his college ambitions. The group 
has given a positive emotional tone to facts to which, unwit- 
tingly, it had in the past given a negative emotional tone. In 
this example the attitudinal orientation method used was 
group discussion , discussion not so much of Johnny and of 
Johnny’s problems, but rather of colleges and of people who 
went to them. The facts dealt with in attitudinal orientation 
are more social than personal. 

Such emotionally toned facts can be dealt with, not only in 
group discussion, but also in group activities. Several experi- 
ments have shown that nursery-school children and college 
students can be changed from shy, self-conscious individuals 
to self-confident, social persons by giving them a social skill 
and some success in group activities. Encouraged by their 
limited success, they move on to more extensive activity and 
greater socialization; finding that their more social selves are 
liked and welcomed by others, they extend the social self until 
it incorporates most of the self. The aphorism that “Nothing 
succeeds like success” constitutes popular recognition of the 
effectiveness of successful participation in group activities as 
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a method of attitudinal orientation. In the fact that the con- 
verse should also be true, that “Nothing fails like failure,” we 
have perhaps the explanation of why so many group-work and 
student-activity programs fail to help some individuals who 
are directed to them. The insecure and unsocialized person 
enters the new group awkwardly, without the emotional support 
which he hoped to find there and which the preoccupied group 
leader is unable to give him; he thus alienates the other mem- 
bers of the group instead of winning their support. Failing at 
the start, he soon drops out of the group. If, on the other hand, 
the person in question is able to establish some sort of relation- 
ship with one or more members of the group, he enters into it, 
engages in its activities, becomes aware of its values, assimilates 
its attitudes and makes them a part of his own. Successful 
identification with the group results in the patterning of the 
self after the group in many important ways. 

But there are other ways in which group activities can con- 
tribute to the attitudinal orientation of the individual. The 
person who is already a member of a group, and who with it 
visits industrial plants, housing projects, slum areas, or art 
exhibits, carries away with him impressions of group evaluations 
of things that have been seen and heard, and these group eval- 
uations help to modify his own attitudes and values. The stu- 
dent who helps plan a dance, copes with a problem of ethics in 
a student government meeting, or works with others in design- 
ing the sets of a play, submits to the influence of group experi- 
ence in which the attitudes and values of his colleagues are 
forcibly brought to bear on him. Emotional maturation and 
socialization should be the effect of such experiences on those 
who are sufficiently self-directing and self-integrating to assimi- 
late them and to use them constructively. 

This brings up a point which should be emphasized again in 
concluding this outline of what I have called orientation tech- 
niques, both factual and attitudinal: the use of group orienta- 
tion techniques involves the assumption that the individual 
members of the group are sufficiently self-directing and self- 
integrating to assimilate new facts, even when these are emo- 
tionally unacceptable. While attitudinal orientation in group 
discussion gives the individual some help in this process, by 
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letting him express his feelings and by bringing to bear on him 
social evaluations of which he was not fully aware, it is still 
up to the individual to understand his own feelings and to 
assess those of the group. It seems logical to expect that, when 
the attitudes and values surrounding an emotional problem 
are more personal than social, the individual in question will 
not he able to solve them with no more help than is given by 
attitudinal orientation. Group support and shared experiences 
will not produce the release of tension, self-acceptance, and 
insights which are needed. 

'Therapy.- Group therapeutic or counseling procedures have 
been developed as a means of meeting needs which could not 
be met by group orientation methods, but their origin was 
actually not in the school, thccollege, or the group-work agency, 
but rather in the mental hygiene clinic and the mental hospital. 
It was the inability to devote the needed time to therapeutic 
work with individuals that suggested group therapy, rather 
than any consciousness of the unmet needs of individuals par- 
ticipating in group orientation programs. Perhaps the failure 
of group orientation methods to lead to the development of 
group counseling was due to the fact that those responsible 
for the former were either teachers or teachers turned coun- 
selors, and that group work to them seemed synonymous with 
instruction, however progressive its methods. To the clinicians, 
however, group methods did not mean instruction. Instead, 
they meant the adaptation of the techniques of individual 
counseling to use with groups. Group therapy was the natural 
result, first in the form of group discussion, and then in the 
form of group activity. 

Group Discussion has been used to provide group therapy in 
a number of different forms. A useful classification of these 
seems to be that of Cathartic-Supportive Group Therapy, Non- 
directive Group Therapy, Group Development, and Interpre- 
tive Group Therapy, arranged in ascending order of directive- 
ness. 

Perhaps Cathartic-Supportive Group Therapy should be sin- 
gled out as one group-guidance method which has generally not 
originated in the clinic or hospital, but rather in the religious 
revival. It is one of the methods of various cults and groups 
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which have cultivated catharsis in the public confessional and 
absolution through confession to the group. Direction is given 
to the therapy by the cult, which specifies the types of sins 
which should be confessed, the time, place and method of ca- 
tharsis, and the means by which the group expresses its emotional 
support of the penitent, whether in the revivalistic form of 
“halleluiahs” or the Buchmanite form of invitations to high- 
class houseparties, But the treatment is largely through per- 
mitting the free expression of certain types of anxieties, 
accepting the individual no matter how reprehensible his 
problems, and an example of faith and fervor with its accom- 
panying power of suggestion. 

One of the newest forms of therapeutic discussion is Non- 
directive Group therapy, which got off to a rapid start during 
World War II when a number of Rogers’ students were assigned 
to rehabilitation work with combat fatigue patients in military 
hospitals, at a time when nondirective counseling theory was 
just beginning to command widespread attention. As in the 
counseling of individuals, the nondirective group method con- 
sists of acceptance, reflection and clarification of feeling, and 
reliance upon the integrative forces in the individual to lead 
him to assume responsibility for working through his problems 
in the permissive atmosphere of the therapeutic relationship. 
Apparently almost any group of people of roughly similar age 
and educational status interested in improving their own ad- 
justment can form a therapeutic group, using almost any emo- 
tionally toned topic for discussion. Thus, groups of graduate 
students have met once a week for therapeutic sessions around 
the topic of anti-semitism, and found that in the process of 
exploring their feelings on this issue they laid bare their con- 
cepts of themselves and of their role in society, discussed their 
values and objectives in relation to those of other persons, and 
worked through their feelings toward a variety of other people. 

What is commonly referred to as Group Development, includ- 
ing Group Dynamics, might more accurately be called Group 
Interaction Therapy, for the basic principal of this type of 
group therapy seems, to an outsider who has not had the ex- 
perience of going to Bethel, to be that understanding one’s own 
behavior in a group results in insight and in the modification 
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of attitudes. The key technique is the recording n e -i. 
and amounts of personal interaction in the uroun f ? e , ^ 
cussion of the nature of the group process dis ‘ 

the group in question. The group fiL behaves whiled^ in 
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ment of insight, whether as the result of taking responsibility 
for working through one’s feelings or of interpretation; and, (5) 
the feeling of ability to face life’s problems which comes from 
having put them into words and achieved an understanding of 
both one’s own feelings toward them and of the attitudes of a 
number of other persons. 

Group Activity for definite therapeutic purposes seems to have 
been tried largely through the psychodrama and role playing. 
The basic assumption in the psychodrama is that in the make- 
believe world of the stage the individual can express his needs 
and his reactions to pressures and that this cathartic release 
of tension will make possible better insight. There is also the 
assumption that constructive forces will then come into play, 
and that letting them direct the individual's action on the stage 
will provide him with the opportunity to develop and to under- 
stand his hitherto submerged but more positive self. 

This second principle led to the development of role playing 
as a somewhat distinct activity method of group therapy. The 
client or patient is assigned a role to play on the stage, instead 
of being left to devise his own role as the action progresses. 
This set role may be chosen by the therapist directing the role 
playing, in an attempt to help crystallize a self-concept which 
appears to be emerging in the patient; it may be chosen by 
the counselor and client together, the choosing itself being a 
part of the therapeutic process ; or it may be allocated to the 
individual by the group, as together they plan the roles to be 
played by each member of the group. In this last case group 
discussion merges with group activity as a therapeutic tech- 
nique, the group playing an active part in developing the role 
of the member, but the leader also playing a part in order to 
protect the individual from having a harmful role assigned to 
him. Once the role has been chosen, by whatever method, it is 
then up to the individual to develop it in action on the stage. 
The way in which he does this is usually criticized by the group 
afterwards, thus giving him an opportunity to see how well he 
has taken on the characteristics of the role. Practicing the new 
character is presumed to leave a permanent impression on the 
personality of the actor. The presumption is made plausible by 
the postulate that the role enacted is one which gives play to 
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traits and values which are emerging and becoming dominant 
in the personality of the client. 

As our bird’s eye view of group-guidance methods has taken 
in a variety of techniques, it may be well to enumerate them 
again at this point. They are as follows: 

Orientation 

Factual 

Discussion 

Activities 

Altitudinal 

Discussion 

Activities 

Therapy 

Discussion 

Cathartic-Supportive 
Nondirective 
Group Development 
Interpretive 
Activities 
Psychodrama 
Ride Playing 

Our next questions are, what arc the limitations which seem 
inherent in these methods, and what is their place in the total 
program of guidance services? 

Limitation of Group Methods 

The most important limitation inherent in group orientation 
procedures stems from the assumption that orientation results 
in adjustment. That this assumption is not always warranted 
has been shown for vocational guidance by the studies of the 
General College at the University of Minnesota, where Stone 
found that occupations courses did not appreciably improve 
the educational-vocational adjustment of students unless they 
were combined with counseling which assisted the student in 
applying to his own case the facts and attitudes to which he 
was exposed. It has also been shown in studies such as those of 
Kefauver and Hand, who reported for example that the per- 
centage of low-ability pupils in junior high school aspiring to 
go to college was increased, rather than decreased, by exposure 
to a course in educational and occupational opportunities. From 
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findings such as these we are probably warranted in concluding 
that only the better-adjusted, more insightful, and more self- 
directing individuals are able to profit much from group guid- 
ance which consists largely of the dissemination of facts, if these 
facts are presented to them at a time when they have already 
had the opportunity to build up emotionalized attitudes con- 
cerning the topics in question. Provision of opportunity to dis- 
cuss the personal implications of newly ascertained facts, and 
the airing of attitudes by group members, so as to permit in- 
dividuals to reorganize their attitudes and values in the light 
and with the support of group thinking, seems likely to be 
helpful when the attitudes and values in question are more 
social than personal, but not when they are highly personal 
and deeply imbedded in the experience of the individual. 

In such instances therapeutic rather than orientational meth- 
ods are called for. But what are the limitations which seem to 
be inherent in group therapeutic methods? Because of the new- 
ness of these techniques, interest in which was limited until the 
War gave them new importance, relatively little is known on 
this subject. We are still in the stage of exploring their possi- 
bilities; awareness of their limitations will only come later. But 
one might hazard a guess as to what they will prove to be. I 
suspect that group therapy will prove to be effective only when 
the group is relatively homogeneous in educational attainment 
and when the individuals constituting the group are persons 
in whom the homeostatic or integrating force is strong, in whom 
the need for group support is real, and in whom the more press- 
ing adjustment problems involve interpersonal relations 
rather than interpersonal relations. That is, they will be persons 
who are best described in the terms of an Adlerian, a Freudian, 
or a Rankian, rather than of a Jungian, psychology. 

'The Place of Group Methods in a Guidance Program 

Having surveyed the various major types of group guidance 
and considered their limitations, we should now make an at- 
tempt to relate them to each other and to other types of guid- 
ance services, in order to see how they fit into a guidance 
program in an educational institution, a group work agency, or 
a guidance center. I assume that we are not concerned here 
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with psychotherapy of the more thorough-going sort, nor with 
the guidance services of mental institutions. 

Orientation programs are primarily a function of schools and 
colleges. Most factual orientation work should be integrated 
with the curriculum, giving students the facts that they need 
in order to develop legitimate vocational aspirations and sound 
social attitudes before vocational and social problems become 
so acute that information cannot effectively be used. As there 
will inevitably be times in the educational, vocational, and 
social development of young people at which choices need to be 
made, and as facts assume a new significance at those points, 
there isa place for formal orientation activities in educational in- 
stitutions and in group-work agencies. There is a place for them 
also in guidance centers which work with people who have no 
group affiliations and whose orientation problems are closely 
related to problems on which they are receiving individual 
counseling. As the need to make decisions heightens the emo- 
tional value of facts, formal orientation activities provided at 
the choice points of development need to be not only factual, 
but also altitudinal. There must be time for members of the 
group to express their attitudes toward the facts encountered, 
to work through their related feelings, and to modify their 
attitudes to make them fit the facts. 

Group development and nondirective group therapy seem to 
me to be techniques which are also appropriate for use with 
persons who are going through the normal processes of personal 
development. Late adolescence and early adulthood are periods 
in which a process of integration is taking place in the individ- 
ual; it is in these years that he crystallizes, tests out, and re- 
vises concepts of himself in relation to other persons, and it is 
in these years also that internal forces are being organized and 
synthesized into a more or less integrated personality. The 
methods of group dynamics appear promising for use with per- 
sons who are not completely socialized and who want help in 
understanding their own roles in relation to other people, so 
that they may modify their social behavior and be more effec- 
tive in interpersonal relations. I suspect that we shall find that 
this approach is most appropriate for persons of post-college 
age, is useable with many college students, and is definitely less 
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appropriate at the high-school level, for it must require a sub- 
stantial degree of maturity and insight to profit from a picture 
of one’s behavior in a group. 

Nondirective group therapy, on the other hand, should prove 
useful with high-school age boys and girls as well as with older 
persons. The technique has been used in college teaching, and 
may well be adaptable to courses and activities designed to 
have character-building values with boys and girls of high- 
school age. It may prove to be the technique par excellence of 
Hi-Y discussion groups, Sunday school classes, orientation 
courses dealing with problems of social behavior, and other 
groups in which an attempt is being made to help adolescents 
and young adults to achieve self-integration. By providing a 
permissive situation in which they can express and work 
through their feelings on problems of importance, discussion 
groups using nondirective techniques should be able to reach 
many people who would never see a personal counselor or who 
could not be served by one if they did seek him out. 

Role playing is another method of group therapy which has 
shown signs of being useful in educational institutions and in 
guidance centers. It can be used in helping young people to 
learn social skills and to acquire confidence in social situations, 
whether the skill be asking a girl to dance or applying for a job; 
it can be helpful in coaching group leaders, in inducting sales- 
men, and in training vocational counselors. Role playing in- 
volves trying out skills, exercise in putting an emerging self- 
concept into practice; it involves converting ideas about one’s 
behavior into concrete, criticizable action. It can be used at 
almost any age level, and in connection with a great variety of 
needs and problems. 

The psychodrama and interpretive group therapy are, I be- 
lieve, more likely to remain useful with individuals who are 
more disturbed, more inhibited, and less socialized than those 
most of us are likely to spend much time with in schools, col- 
leges, group-work organizations and guidance centers. These 
are more peculiarly clinical techniques, useful in the clinic and 
in the hospital. 

Before concluding this discussion, a few words should be 
devoted to the relative emphasis which one might expect to 
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find placed cm group and individual techniques in a guidance 
program. One might even ask, is it at all likely that group 
guidance can meet the needs of the great majority of students 
and adults, leaving individual counseling for special cases only? 

I think the answer to this question must be in the negative 
for while group methods can do a great deal of preventive work' 
and can even do a great deal of creative work, I think it will 
always be true that most people can benefit from opportunities 
to discuss their attitudes, aspirations, and plans with a sym- 
pathetic listener who has special skill in clarifying issues and 
who has a perspective on problems and opportunities such as 
come only with professional training and experience. A good 
program of group-guidance services should forestall the develop- 
ment of some problems, should assist in the growth of better 
integrated personalities, improve personal, social and occupa- 
tional orientation, and finally, should render people better 
able to make effective use of personal and vocational coun- 
seling services when and as they are needed. 



APPLYING GROUP METHODS IN THE VETERANS 
ADMINISTRATION ADVISEMENT AND 
GUIDANCE PROGRAM 

IRENE G. COOPERMAN 

Chief, Special Guidance Programs, Veterans Administration, Washington, D. C 

Group methods in guidance are used in the Veterans Ad- 
ministration advisement and guidance program as a supplement 
to individual counseling. In this role, they have four major 
objectives, as follows: 

I. To stimulate veterans to consider their vocational future 
and to take appropriate action regarding their vocational 
problems 

1 . To broaden veterans’ occupational horizons. 

3. To impart guidance information about specific occupa- 
tions. 

4. To assist in the veteran’s reorientation and readjustment 
to civil life through the presentation of necessary infor- 
mation and the development of appropriate attitudes. 

Included within each of these broad objectives is a number 
of specific aims, any one of which may serve as the subject 
of one or more group sessions. The specific aim to be set for a 
group program is determined, of course, by the needs of the 
particular group of veterans to be served. Examples of specific 
aims of group guidance programs for veterans are the following: 

1. Providing accurate and complete information regarding 
veterans’ rights and benefits, especially those relating to 
rehabilitation and education. 

2. Promoting understanding of the nature of the benefits 
to be derived from advisement and guidance services. 

3. Presenting overviews of many different kinds of work 
to acquaint the veteran with the wide range of possi- 
bilities open to him. 

4. Presenting detailed information — such as the nature of the 
work, requirements, hours and earnings, etc. — for various 
specific occupations. 
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5, Informing veterans concerning job trends and outlook 
for employment in various occupational fields, including 
self-employment in small businesses and agriculture. 

6, Assisting veterans to view realistically their plans for 
self-employment by presenting discussions of require- 
ments for success in small businesses and agriculture, etc. 

7. Providing current information regarding local training 
and employment opportunities. 

8. Providing needed instruction regarding the writing 
of adequate letters of application, techniques of applying 
for employment, etc. 

The use of group methods directed toward these and similar 
aims and, through them, toward achievement of the four general 
objectives cited has been authorized in all Veterans Adminis- 
tration hospitals and in those Army and Navy Hospitals where 
the Veterans Administration provides advisement and guidance 
services to servicemen about to be discharged. Included are 
general medical and surgical, neuropsychiatric and tuberculosis 
hospitals. The hospital population of World. War II veterans 
from which group members are assembled includes, of course, 
both veterans who are eligible for vocational rehabilitation 
under Public Law ifi and those who are eligible for and request 
education or training under Public Law 346. Considerations 
of a professional nature, as well as administrative factors such 
as the number of personnel available, have made it necessary 
to limit the use of group methods to hospital advisement. 
Problems relating to the identification of groups of veterans 
having common needs from within the community at large, 
assembling such veterans for more than a single group session, 
and integrating group methods with individual counseling 
raised serious questions as to the practicability of applying 
group methods in the over-all Veterans Administration advise- 
ment and guidance program. The hospital, on the other hand, 
represents a relatively well-controlled situation, with veterans 
available for participating in group guidance activities over 
a period of time. Counseling hospitalized veterans takes place 
in a series of sj^wons. There are, therefore, opportunities for 
integrating grodp meetings with the steps in individual counsel- 
ing. Thus, sessions designed to advise the veteran concerning 
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his rights and benefits or to orient him regarding the advisement 
procedure may precede individual advisement or may, along 
with programs giving general overviews of broad occupational 
fields, be used in the early stages of such advisement. Meetings 
devoted to specific information regarding particular occupa- 
tions, on the other hand, may more profitably be introduced 
when selection of the employment objective is being tentatively 
considered. Even in hospitals, however, as we shall see later, 
problems attendant on patient turnover and similar factors 
cause no little difficulty in planning and carrying out a con- 
tinuing group-methods program. 

Responsibility for carrying on Veterans Administration hos- 
pital group-guidance activities rests with the same vocational 
advisers who do individual counseling in the hospitals. These 
personnel were, for the most part, already on duty when the 
use of group methods was instituted. Their selection was, there- 
fore, based on their general competence as vocational advisers 
plus special experience or training in rehabilitation of the seri- 
ously disabled or in clinical psychology, without special regard 
to experience in the use of group methods. As professionally 
trained counselors, however, they do have one of the basic 
qualifications for effectively applying group methods in vo- 
cational guidance — namely, a sufficient knowledge of the 
philosophy and techniques of counseling to be aware of the 
limits within which group methods may validly be used. From 
this pool of available personnel, those individuals were, insofar 
as possible, chosen for assignment to the development of hos- 
pital group-guidance activities who had had some experience 
in the use of group methods, either in vocational guidance 
itself, or in connection with educational or recreational pro- 
grams, such as club work or adult education projects. 

Before proceeding to a description of actual practices and 
methods, the relationship between group methods and individ- 
ual counseling in the Veterans Administration program should 
be clearly indicated. Group methods in guidance are used 
as a means of making more effective the individual vocational 
and educational counseling services offered to hospitalized vet- 
erans. In no case are they used as an alternative to individual 
methods. No veteran is expected to make his decision as to 
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vocational or educational objective as a direct outcome of 
attendance at group-guidance sessions. For veterans participat- 
ing in group-guidance activities, just as much as for those 
vvlio do not, choice of a vocational objective is made on the 
basis of individual counseling procedures. These include in- 
dividual interview, application of appropriate psychological 
tests, and consideration of relevant medical data regarding 
the veteran, correlated with occupational information con- 
cerning the requirements and opportunities of fields of work 
that analysis indicates to be suitable as tentative objectives. 
None of the steps in the individual counseling process, as out- 
lined in the Veterans Administration Manual of Advisement 
and Guidance;, has been eliminated as the result of applying 
group methods in guidance. Veterans Administration advise- 
ment and guidance policy emphasizes the need to consider 
each veteran as an individual, to identify the particular pattern 
of traits and abilities that characterizes him, and to take into 
account all of the relevant facts in his social, educational 
and economic history and adjustment. Collecting and inter- 
preting these data for the veteran to use in deciding on his 
vocational objective and assisting the veteran to formulate 
plans to meet his goal are regarded as matters for individual 
counseling. 

We have thus far defined fairly precisely what group methods 
are not expected to accomplish. How, then, are they used 
and what are their values in our program? First, they are 
an effective means of stimulating veterans, early in their hos- 
pital stay, toward constructive thinking and planning about 
their vocational problems. In many cases veterans are able 
to participate in group-guidance sessions before they are medi- 
cally ready for individual advisement. Such programs, therefore, 
not only serve the purposes of motivation and vocational orien- 
tation, but also are a means of directing the veteran’s thinking 
at an early dace toward the time when he will leave the hospital. 
As such, they have the important therapeutic effects of raising 
morale and providing an incentive for recovery. Group-guidance 
sessions have, in many instances, been helpful in integrating 
physical medicine rehabilitation and vocational rehabilitation 
services, Through group sessions in which medical rehabilita- 
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tion personnel participate, veterans are informed of the educa- 
tional and manual arts therapy activities of the hospital and 
how they may serve as useful devices for exploring and trying 
out vocational aptitudes and interests. The realization that 
selecting an occupation is important and that this process 
of selection differs from merely drifting into a job is brought 
home to many veterans for the first time The need for help 
in arriving at a vocational decision is stressed and the avail- 
ability of such help in the form of professional counseling 
services pointed out. For seriously disabled veterans, in par- 
ticular, group sessions provide an effective medium for improv- 
ing attitudes. Acceptance of the limitations imposed by the 
disability is facilitated by helping such veterans to realize 
that by concentrating attention upon remaining abilities in- 
stead of focusing it upon disabilities, the opportunities for 
useful work not only are not lost but may actually be extended 
through proper training. Straightforward presentation of in- 
formation regarding the occupational abilities in relation to 
the implications of disability and explanation of the basic 
facts and logic of selective placement help to overcome feelings 
of discouragement and resistance to counseling or any form 
of vocational planning. Veterans benefit by the pooling of 
experiences and by the interchange of opinions, and are helped, 
by the knowlege that their problems are not unique, to view 
such problems objectively. 

As a medium for conveying occupational information, group 
methods make possible broader coverage of occupational fields 
than time would permit on an individual basis. Such over-all 
survey type of information regarding numerous fields of work 
helps to widen group members’ vocational outlook and to 
enlarge the frame of reference in which their occupational 
choices will finally be made. Detailed information regarding 
specific occupations in which group members have expressed 
tentative interest is given in order to help dispel, in advance 
of the individual counseling situation, unrealistic notions con- 
cerning the nature of the work involved, salaries to be expected, 
etc. The veteran, as the result of attendance at such sessions, 
comes into the individual counseling interview with a better 
vocational orientation than might otherwise be the case. The 
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discussion that is encouraged in group sessions helps to insure 
understanding of the material presented and is thus preferable 
to simply putting occupational information publications in the 
hands of veterans to read. 

Through sessions that explain the nature and function of 
advisement and guidance, group methods further help to pre- 
pare the veteran for individual counseling. In such sessions 
the roles of the veteran and counselor are explained and the 
fact that the counselee is an active participant in the process 
is stressed. In preparation for such participation, the veteran 
is stimulated to self-study and to organize some of the infor- 
mation he will be expected to provide in the counseling inter- 
view. At the same time, the need for analysis of his abilities, 
aptitudes and interests through psychological tests is empha- 
sized. The complexity of the factors entering into good 
vocational planning and the need for professional assistance 
>n interpreting and weighing these factors are explained, 

In connection with the latter, group methods have proved 
extremely effective. The introduction of the use of group 
methods in VA hospitals has resulted in a greatly increased 
demand for individual counseling. In some instances it has 
even been necessary to curtail temporarily the number of group- 
guidance programs, lest the resulting demand for individual 
counseling far exceed the working capacity of the advisement 
and guidance personnel available. One neuropsychiatric hos- 
pital reports that 75 per cent to 85 per cent of the veterans 
attending programs which explain the nature and values of 
the services rendered by the vocational adviser and the need 
for vocational planning subsequently request individual coun- 
seling. This active seeking of the services of the vocational 
adviser on the part of neuropsychiatric patients contributes 
to the success of the counseling. As stated by the vocational 
adviser at this hospital, if the veteran will seek counseling he 
is much more likely to accept counseling. 

A description of current practices and methods offers some 
difficulty, because of the wide variation existing among hos- 
pitals, Some hospitals have used group methods much more 
extensively than others; some employ them to accomplish very 
limited aims, whereas others have used to the the full extent 
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the authorization contained in the Central Office directive set- 
ting forth the objectives of group methods in the VA pro- 
gram. While such variation admittedly has some undesirable 
features, it is inevitable in a program as far-flung as that of the 
VA. Applying group methods in a neuropsychiatric hospital, for 
example, poses problems different from those in a general med- 
ical and surgical hospital. Factors such as the size of the 
individual counseling case load and its relation to the number 
of vocational advisers available inevitably influence the extent 
of use of group methods. Central Office has, therefore, under- 
taken only to lay down the broad outlines of the group methods 
program, to define its objectives and scope, and to provide 
some instructional and technical aids regarding methodology 
and programming. Specific application must, however, be in 
terms of the local situation, and the major responsibility for 
developing programs rests with the vocational adviser in the 
hospital. It is he who has first-hand knowledge of the needs 
of the veterans whom he sees; he is, therefore, in the best 
position to plan meaningful programs and to cut and tailor 
his use of group methods to fit his specific needs. The following 
account of practices is, therefore, a composite picture of VA 
group-guidance activities and does not represent the program 
of any one hospital. 

A patient’s participation in group-guidance activities, as in 
any other hospital activity, is contingent on approval by the 
responsible physician. As soon as possible after medical ap- 
proval is given, the vocational adviser meets with groups of 
veterans. These initial sessions are ordinarily concerned with 
general matters, such as explaining rehabilitation and educa- 
tion and training benefits under Public Laws 16 and 346, 
defining the purpose of vocational advisement and its relation 
to other hospital services, or stimulating group members to 
enroll in occupational and manual arts therapy activities. Often 
such sessions are held on the wards for veterans who are not 
yet ambulatory. Sometimes the hospital’s public address system 
is used. Examples of ward programs successfully used in one 
of our tuberculosis hospitals include the following topics- “Jobs 
for the Tuberculous,” “Guidance and How it Can Help You,” 
‘Public Law 16 and How it Operates.” Ward programs are 
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necessarily general in nature, since the group is an unselected 
one, except as to disability, and likely, therefore, to be hetero- 
geneous in interests and educational level. 

Succeeding programs deal with a wide variety of topics. 
Examples are "Why Vocational Advisement?”, “Factors In- 
volved in Vocational Planning," "Getting the Most from Vo- 
cational Advisement,'" “So You Want to Start Your Own 
Business," “Teaching {or any other specific occupation) as a 
Career,"' “How to Apply for a Job.” 

Programs are varied in nature, depending on the nature 
of the subject matter and the resources available. Insofar as 
possible, groups are restricted in size, so as to encourage active 
participation by all group members. Often there is just informal 
discussion; sometimes a brief talk by the vocational adviser, 
followed by a question-and-answer period. Representatives 
from business, industry and the professions and from other 
government agencies have cooperated as guest speakers and 
members of panels. 

Motion picture films and other visual aids such as film 
strips, posters, and charts form an integral part of many VA 
group -guidance programs. Films on occupations and industrial 
processes, on rehabilitation and employment of the handicapped, 
properly supplemented and followed up by other activities 
have been found useful in stimulating interest, developing 
desirable attitudes and conveying occupational information. 
To assist hospital vocational advisers in the effective use of 
films in guidance, Central Office maintains a review and evalua- 
tion procedure for the selection of appropriate films and issues 
a series of film digests containing descriptive and evaluative 
information. Only those films approved by Central Office are 
authorized for group-guidance use. To date, approximately 
thirty-five film titles have been authorized for hospital use. 
The VA has purchased a quantity of prints of about half of 
these films and the remainder are procured on a loan or rental 
basis. The number of approved films is expected to be raised 
to approximately fifty within the near future. 

Another technique that is utilized is the occupational field 
trip. Small groups of veterans who have indicated interest 
in particular occupational fields are taken on visits to industrial 
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plants and commercial concerns to see employees at work in 
these occupations and to learn, first-hand, the environmental 
conditions of such employment Such trips are followed up 
by discussion and reference to pertinent occupational literature. 

The difficulties encountered in our use of group methods 
may be of interest. Personnel stringencies are, of course, of 
paramount importance and have grown more and more acute 
With sizable case loads awaiting advisement, vocational ad- 
visers have had to give priority to individual counseling. As 
procedures which supplement and enrich such counseling, but 
are not an intrinsic part of it, group methods in guidance have 
been employed on an “as possible” basis. Secondly, continuity 
of program has been difficult to maintain. The period of hos- 
pitalization of group members has varied, making it difficult 
to assemble the same groups repeatedly In general, and in 
medical and surgical hospitals particularly, the average period 
of hospitalization is brief, making the planning of anything 
beyond general orientation sessions difficult In addition, there 
are many competing demands for the time of the hospitalized 
veteran. Medical treatment necessarily has first call; schedul- 
ing group sessions that will not conflict with the hospital 
regimen has, therefore, presented some problems. The chief 
difficulty, however, lies in assembling veterans into homo- 
geneous groups. The use of pre-existing groups, such as groups 
of patients assigned to the farm detail, the woodshop or other 
activities, patients in the same ward, etc., is not satisfactory, 
since such assignments are made for a variety of therapeutic 
reasons and do not imply homogeneity in the respects that 
are important for group-guidance purposes. Information from 
lecords and from hospital personnel who know the patients 
and data from the individual counseling records in the cases 
of those veterans who have begun their counseling, assist the 
vocational adviser in selecting group members and in planning 
appropriate programs. The veteran’s expressed interests are 
often the selective factor. 

A few statistics may be in order at this point to indicate 
the extent to which group methods are being used in our pro- 
gram. The most recent data that we have covering all hospitals 
are for September, 1948. During that month, of 140 hospitals 
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reporting, 92 or approximately two-thirds had some group- 
guidance activities. Seventy-eight of these were VA hospitals 
5 were Army and 9 were Navy. General medical and surgical 
hospitals accounted for 48 of the total, tuberculosis hospitals 
it, and neuropsychiatric 16. A total of 427 group sessions was 
held during the month with 4,558 veterans and servicemen in 
attendance. The average attendance per session was 10.7. Par- 
tial data available for January, 1949, for VA hospitals only 
indicate that in these hospitals group-guidance activities are 
continuing at approximately the same level as in September, 
1948. 

Finally, 1 should like to admit that we are aware that in 
some instances vocational advisers have strayed far from Cen- 
tral Office policy and have used group methods for purposes 
of questionable validity. It is the function of supervision to 
correct such deviations, and we intend to correct them as 
promptly as possible. 



GROUP DISCUSSION IN AN ADULT COUNSELING 

PROGRAM 

A C. VAN DUSEN 

Associate Professor of Psychology, Northwestern University 

Counseling experience with the so-called “normal” adult 
population has resulted in the observation by practically all 
counselors that to occasionally have a problem to which there 
is no immediate solution is the rule rather than the exception. 
Likewise, effective solutions to frustrating situations seem to 
come by way of either changes in what the individual wants, the 
opportunities available to him, or by improvement in the meth- 
ods he uses in going about obtaining what he wants. At any 
rate, the process of working out solutions to problem situations 
seems to require some perceptual reorganization of the individual, 
wherein he gains a better understanding of his behavior, what 
he wants, the consequences of getting it, and the relative merits 
of using one or another method in getting satisfaction. To 
facilitate this understanding and to encourage the individual’s 
more effective adjustment is the objective of most counseling 
programs. 

The adult counseling program which I would like to describe 
briefly to you uses certain group procedures in an effort to 
better and more quickly realize these objectives. The counsel- 
ing program is in the evening division of Northwestern Uni- 
versity. Adult students who are seeking help register for it as 
they would for a regular academic course. It is scheduled for a 
one-hour and forty-minute meeting weekly. It carries no credit, 
and no grades are assigned. The enrollment is limited to about 
fifty students each semester. This arrangement permits as many 
as sixteen weeks to work through the problems which are 
brought to the counseling program, whichis listed in the Bulletin 
of Courses as “Vocational Counseling.” 

The Counselors who serve these adult students are graduate 
students in Psychology, Educational Guidance, and students 
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in a division of the Graduate School designed primarily for 
professional training in guidance and personnel work. At the 
present time, there are thirteen such Counselors, each serving 
four or five clients. 

The staff who supervise the program and the practicum train- 
ing of these graduate-student Counselors are three experimen- 
tally biased psychologists. They have each held responsible 
counseling positions in a variety of clinical, academic, and 
industrial situations. 

The program itself is based upon the realization that most 
people do not get into quandaries "over-night” and that it is 
unrealistic to expect them to work out effective solutions im- 
mediately. Rather, it is assumed that the counseling experience 
should be an opportunity foi each client to experience a proc- 
ess of re-education which would include not only establishing 
at least a tentative solution to his immediate problem, but 
which would result in his developing problem -solving principles 
which would serve him in future conflict situations. Operation- 
ally, the program uses many techniques. Chief among them are 
group and individual testing, personal interviews with the Coun- 
selors, and a variety of group procedures. 

Our purpose here is to describe especially the group pro- 
cedures which are articulated with the other aspects of the 
service program . We want to describe these procedures and show 
how they are used to facilitate the counseling process. Many 
aspects of the counseling process which have been traditionally 
reserved for the private interview are now being explored in the 
group setting. We believe that these efforts not only signifi- 
cantly aid the individual to better understand himself and to 
work out solutions to his difficulties because of the group at- 
mosphere, but that the group procedures are often economical 
in saving much of the interview time, formerly used in exploring 
issues which now seem to be even better accomplished in the 
group setting. 

Since the beginning of the program three years ago a number 
of different ways of integrating the group procedures with ihe 
private individual interviews have been tried. We consider our 
program an experimental one and, therefore, we will probably 
continue to try many more ways before we are satisfied. The 
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latest arj-angement which has emerged from our trial-and-error 
process is the one we want to present here. 

We start right off with a group session concerned with the 
matter of orientation of the clients to the program, and, as a 
matter of fact, an orientation of the Staff and Counselors to 
them. Here we try to define the role of the student who is 
seeking help, the role of the Counselor in his contacts with the’ 
student, the role of the discussion leaders in the group sessions, 
and finally we try to discover from the group what they expect 
to get from the program. For them to create what we hope is a 
realistic frame of reference in defining how a counseling program 
can be of maximum value to them, we have made use of the 
“buzz session” technique. The group leader simply breaks the 
group of fifty down into informal small groups of five or six 
students each, who are sitting close to one another. He asks 
them to discuss among themselves for 3 to 5 minutes the kind 
of help the staff can be to them and what they had hoped the 
program could do for them. Then a spokesman from each sub- 
group reports the consensus expressed by his associates. The 
group leader interprets until there seems to be a fairly uniform 
understanding of the intent of the spokesman and he then lists 
the key comments on the blackboard. This is done for each 
small sub-group 

This method helps, from the beginning, to show the clients 
that they may expect to shoulder considerable responsibility 
during their experience with us. Sure, even before they are given 
an issue to “buzz” about, they are given a chance to get ac- 
quainted. We have been amazed at how well, in general, the 
objectives of counseling which evolve from their discussion 
seem to agree with the objectives we believe pertinent to such 
a program. We feel that the technique accomplishes two things 
immediately One, the “buzzing” in the small sub-groups seems 
to guarantee nearly 100 per cent participation in the relatively 
large total group where such a percentage is seldom obtained 
by more conventional methods. Secondly, we believe that it 
creates a“we-ness” type of atmosphere which facilitates future 
interpersonal communication later in the group meetings and 
in the interviews which follow. 

When all the comments are out, the floor is opened for con- 
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sideration of the objectives expected of the course by the entire 
group. Here, any reasonable idea of what such a program might 
accomplish is usually spotted by some group member and then 
by working through this student’s observation, the group leader 
can get the originators to reconsider their suggestion in the 
light of additional considerations made by the group. The group 
leader then explains in what way our program will try to 
accomplish the objectives they have agreed are worthwhile. 

Where suggestions seem to indicate wards of caution, the 
discussion leader gives them when these suggestions come up. 
For instance, recently a typical "buzz” session comment, in 
discussing what the program objectives should be, included, 
“We think we should make use of psychological tests to show 
our strengths and weaknesses." In review, the staff member 
pointed out that we would use tests, but warned that tests are 
instruments with definite limitations. lie pointed out by analogy 
that like a thermometer, which shows whether the individual 
has a fever but tells nothing as to the cause or the cure, tests 
must be considered as instruments to be used in connection with 
other aspects of the program. The leader uses the group setting 
to encourage each one to prepare to use the personal interviews 
to maximum advantage. Through a little discussion of the pur- 
pose of the interview, a part of the rapport process is started 
even before the first interview appointment is made. 

The following week another group session is spent in ad- 
ministering the verbal part of a core battery of tests. The battery 
includes two intelligence tests, two interest inventories, and 
two personality inventories. We have found the information 
from this battery is helpful to most of our clients. It is needless 
to point out that by group administration we effect a consider- 
able economy in testing time which can be used by the staff in 
ways we believe more profitable to the client. After the group 
finishes each test they again "buzz" in the smaller groups on 
the issue of what kinds of questions, pertinent to the counseling 
situation, the test they have just completed could possibly 
answer. At this point we have felt that a good many of the 
prevalent false impressions and false hopes held in tests are 
corrected. And we feel that having the clients explore, with 
each other in their small sub-groups and then with the dis- 
cussion leader, the limitations of test scores, erroneous ideas 
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concerning the usefulness of tests more quickly dissipate than 
is ordinarily accomplished through the counseling interview 
alone. At least it seems that in most instances, the client has a 
large head-start on understanding the tests when such issues 
arise in the interview. 

After this second group session personal interviews are sched- 
uled for times other than the regular class period. Once the 
Counselor has established contact with a client, scheduling of 
successive interviews is left up to the mutual agreement between 
client and Counselor. By the time the first interview contact is 
made, the client has experienced two group discussion sessions, 
knows a few of the other clients, has helped define what he 
should gain from the counseling program, and although they 
have not been scored, he has discussed and taken several tests 
and has thought about what purpose the interview is to serve. 

During the third week a third group meeting is held. This 
time our objective is to get across the significance of successful 
interpersonal relationships in everyday living. Often our adult 
clients, in exploring the reason for their discontent with their 
current jobs, have found that interpersonal conflicts either on or 
off the job have been more influential in determining their view- 
points than any lack of aptitude or skills. We decided, there- 
fore, that a group session on the “causes of human behavior” 
might contribute to the more adequate identification by each 
client of the particular source of his concern. Our method 
here has been to again warm the group up with a “buzz session” 
to set the stage for a discussion of some of the basic aspects of 
human motivation. The sub-groups are asked to buzz on," What 
kind of information is needed for more effective understanding of 
one another?” Armed with some knowledge of the group’s 
perceptual orientation in this realm, the discussion leader with 
the aid of another group technique, colored cartoons, explores 
with them the importance of human needs and how their 
satisfaction depends so directly upon successful interpersonal 
relationships. Emphasis is placed here upon the reasonableness 
of seeking causes for our own and the other fellow’s behavior . 1 
Even when the specific causes are unidentified, an awareness 
that behavior gets that way through a legitimate process for 
each individual minimizes our inadequate social responses. 

1 Cartoon on "Behavior is Caused” shown. 
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The cartoons help to get over the idea that we all have many 
of the same kinds of needs , 5 but the ways we have learned to 
satisfy them makes for considerable individual differences. 
Through this visual device used in the group we feel that 
explorations of feelings of insecurity and feelings of inadequacy 
come out more readily in the personal interviews, and that 
consideration of the variety of factors that arc operative In a 
given problem situation are more easily sought out, accepted, 
and understood by the client in his efforts to work out his 
difficulties. This technique also seems to aid the individual in 
understanding that we all live many different roles with the 
degree of need-satisfaction playing an important part in how we 
feel in each one. He also frequently gains insight here in how 
he may or may not be contributing through his own behavior to 
the need-satisfactions of his associates on the job, at home, or 
other social situations important to him . 3 We feel that this is a 
legitimate area for all clients to explore, not only for help in 
considering any current problems, but for positive mental hy- 
giene in their future everyday living. 

Another group session is equally concerned with both the 
immediate and long-term view. In the last group session men- 
tioned, we were concerned with the individual’s considering 
his and the other fellow’s present needs and being sensitive to 
their influence on behavior in the future.* The next group 
session is devoted to providing information to both assist in 
resolving the current problem situation and also to provide a 
viewpoint for meeting future problems. It is demonstrated that 
a problem exists whenever the satisfaction of a strong need is 
blocked . 6 At this point the variety of methods which may be 
used in working out problem situations are reviewed. Some 
problem situation probably got our clients interested in our 
counseling program. How have they been going about trying 
to resolve the tensions precipitated by this problem situation?* 
Are there a variety of methods generally used by people, which 
at best lead to only partial solutions and consequently partial 

* Cartoon on need for "Attention” shown. 

'Cartoon on need to "belong" shown. 

* Cartoon on "Goal directed behavior" shown. 

' Cartoon on “Goa! pathway blocked" shown. 

* Cartoon on "non-adaptivc means of overcoming barrier 1 ’ shown. 
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reduction in tension, and how might more effective problem- 
solving procedures be adopted? To get at problem-solving meth- 
ods, several approaches are made. The first group technique is 
through the use of these and many other cartoons again. Using 
them, the discussion leader demonstrates the common elements 
of problem situations and some of the common methods used 
in resolving them. 7 This is done so as to relate what has already 
been said about the causes of behavior to the causes of conflict 
situations. It is pointed out that although some methods used 
in problem situations are ineffective, they have developed like 
any other habit and better methods can not be expected without 
additional information. Then the advantage of using a direct 
analytical approach 8 to a situation which constitutes a major 
difficulty is stressed, 

At this point a second technique is used. A printed form is 
distributed to the group and it is supplemented with "chalk- 
talk” by the group leader. The form is designed to help them 
understand what the analytical approach to problem solution 
amounts to. Through its use the individual may bring to bear 
his resources directly upon the problem. We believe it takes 
advantage of the usual thought processes which frequently 
are not too systematic and provides at the same time a means 
for the client to develop a realistic solution to his problem 
situation. The prototype of the procedure came from R. H. 
Seashore’s experimental methods. We have adapted the pro- 
cedure for use with personal problems and refer to it as the 
“four-column analysis.” 5 The latest revision simply asks the 
client to consider himself and his present situation and to jot 
down in the appropriate columns the answers to these ques- 
tions: (1) What do I want to know or do? (a) What difficulties 
stand in my way and what advantages do I now have? (3) What 
can I do to get what I want? and (4) If I do, what may be the 
results? The discussion leader describes the device, how columns 
do not have to be filled in, in sequence, and how one should jot 
down things as they come to mind, refining only in a later stage. 
Then to facilitate gaining skill in using the device the leader 


1 Another cartoon illustrating maladaptive behavior 
5 Cartoon illustrating removal of barrier shown. 

* Enlarged 4-column Analysis shown. 
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asks the group to think of some situation which might be a 
problem for many of them. A class member volunteers a hypo- 
thetical example. Then the class members begin to make sugges- 
tions of possible entries into the four columns, as the leader 
jots them on the blackboard. Finally, the client group is asked 
to fill in the sheet (several, if needed) before the next week’s 
session and prior to their next interview as an exercise on their 
own problem. 

This technique seems to have the advantage of breaking down 
the worry cycle. The individual jots down on paper many of the 
general and vague concerns and his statements become more 
specific as he makes progress in the group discussions and in his 
sessions with his counselor. It gives him a way of organizing 
his thoughts and of seeing how his feelings are involved in the 
interrelationships between factors which, without somesystema- 
tic orientation, he finds it difficult to recognize. Alternative 
possible solutions can be seen in the light of probable results 
and consequences before actual tryout. It serves as a device to 
work out a specific plan of action on the current problem and 
it is hoped that its general application through this experience 
may be seen for future problems. And, last but not least, it 
facilitates the problem-solving experience without shifting the 
burden from the client to the counselor, a point which seems to 
get increased emphasis in recent professional papers. Here we 
hope we are creating a problem-solving attitude to personal 
problems and to reinforce it through actually going through the 
process. 

The next group session provides an opportunity for the group 
to discuss any difficulties they found in using the four-column 
analysis while on their own, Then another exercise is done in 
the class-meeting through the "buzz session” technique filling 
in the various columns on the general issue of “how to get 
along better with our associates on the job, at home, or in 
social situations,” The importance of understanding how our 
attitudes are developed and the necessity of understanding the 
other fellow is emphasized through the use of more cartoons, 

Through the group procedures outlined above we have tried 
to provide an atmosphere which will facilitate the clients’ work- 
ing out their immediate problems. We believe that the attitudes 
formed from the total counseling experience may provide a 
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helpful frame of reference tor meeting future problem-situa- 
tions. In addition to the sessions we have described that have 
become somewhat standard procedure for the program, we 
try always to maintain a degree of flexibility in scheduling 
group meetings which may be profitable in handling the clients’ 
needs. These needs may be expressed either through the clients 
in their group discussions or in the interviews with their coun- 
selors. 

For example, one group meeting precipitated a discussion 
of the superior and subordinate relationships on the job. They 
decided to have a special session to discuss nothing else. Six 
members of the client group were drawn from a number of 
volunteers to form a panel to lead the discussion with a staff 
member as the moderator. Participation under the direction of 
members of their own group was unusually high. The experience 
proved particularly popular with the clients as reflected in 
many of their comments to their counselors. 

When the Counselors, through regular staff meetings, indi- 
cate that a sizable portion of the client group are expressing the 
same kinds of needs and it is felt that a group meeting might 
help them all, we simply schedule a meeting and ask them to 
attend. Sometimes it is for pure information-giving, such as 
library and other sources of information. Other times they may 
meet for further exploration of factors important to personal, 
social or vocational adjustment. 

Summary 

The group procedures which have been described are inte- 
grated with personal interviews and the use of several semi- 
structured questionnaires. The total process is designed to facili- 
tate the client’s appreciation of himself, the specific nature of 
his concern, and the difficulties which he has to overcome. Fur- 
thermore, the analytical approach to problem solutions is en- 
couraged. Through its use, together with the variety of experi- 
ences with the counseling program, the client seeks a suitable 
plan of action. 

The program is not a “quickie” type service. With the oppor- 
tunity of having sixteen weeks for counseling, many things can 
be explored in both interview and group meetings that time 
limitations alone in shorter programs would prohibit. We be- 
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lieve, however, that die group procedures we have used would 
prove profitable to almost any counseling program, at least for 
the average individual with a problem. 

The early definition of the roles of client, Counselor, and 
group leaders facilitates the client’s willingness to assume the 
major resjionsibility for the solution to his problem. By virtue 
of assuming this responsibility, he more readily accepts as a 
plan for action the solution to his problem which he evolves 
during the counseling process. The warm, friendly, “we-ness” 
feeling developed through the total group participation partic- 
ularly augmented through the " buzz sessions” not only makes 
for better understanding of reactions of group members, but 
provides an, easy entree to the individual interview with a 
counselor. 

Since the Counselors are present in group meetings, their 
understanding of their clients is facilitated by their observa- 
tions of each of their client’s behavior as he relates to the 
members of his small “buzz session,” the members of the total 
group, and to the discussion leader. 

It is a commonplace that people more readily accept and 
have faith in those things which they have personally had a part 
in developing. This certainly is the case in securing a realiza- 
tion of what to expect from a counseling program, the value and 
limitations of psychological tests used, and the analytical 
method of problem-solving. 

The use of the visual cartoons seems to make it easier for 
the client to consider the many factors whose subtle influences 
are frequently disregarded. They are sufficiently different that 
memory of the sketch often serves as a reinforcement value, 

The four-column analysis procedure, with the chalk-talks and 
‘‘buzz sessions” for clarification, serves the client as a method for 
developing on his own, alternate solutions which take into 
account most of the factors pertinent to effective adjustment. 
Through the use of this technique in his counseling experience, 
its application to future problem-situations becomes apparent. 
We fed that useful habit patterns may evolve which provide 
the key to unraveling many ordinary problem situations and 
at the same time build for the future a feeling of confidence 
and independence. 



LEADER FLEXIBILITY IN GROUP GUIDANCE 
SITUATIONS 


DOUGLAS D. BLOCKSMA 
Counseling Center, University of Chicago 

Flexibility is a philosophical construct employed in this 
paper to describe leader behavior that is appropriate to the 
demands of the culture, the institution, and the present needs 
of the group being led. This conference is interested in guidance 
— or how to make group experiences personally relevant to 
individuals. The thesis of this presentation will be that there is 
no single leader methodology, role, or attitude which results in 
meaningful group experience. Variability, adaptability or flexi- 
bility of the leader’s behavior is essential to insure efficacy 
from group to group and for each individual within a given 
group . 1 

Throughout this paper the classroom teacher’s role as group 
leader and guidance implementer will be studied for purposes 
of illustration. Before any evaluation of good or bad, flexible 
or rigid, appropriate or inappropriate leadership methods can 
occur, the criteria for group productivity must be established. 
When is a classroom a group? What conditions should exist in 
an American college class group that are conducive to learning? 

From research and informal experience in evaluating class- 
room outcomes, the following criteria are assumed to be de- 
scriptive of good learning environment: 

I. There is ego involvement of teacher and students in 
meaningful goals and tasks. Equality of opportunity for par- 
ticipation and the desire to utilize individual contributions 
characterize the psychological atmosphere of the class that be- 
comes a group. 

'To illustrate the flexibility principle, a demonstration was presented in which 
the opening session of a graduate class m Industrial Psychology was led by Mr. Arthur 
Shedlin, Denn of Students, University of Chicago Downtown College This type of 
group was employed for demonstration, because much of the guidance in American 
education is, or could be, accomplished in the primary mode of grouping — the class- 
room. 

Dr. Herbert Thelen of the University of Chicago trained the writer in group aspects 
of instruction. 


J3 1 
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1 . Material conditions of time and space are such as to allow 
communication of the total class group and of smaller sections 
of the class. 

3 . Social conditions between leader and students, and among 
students, arc such that through acquaintance and effort com- 
mon purposes evolve; individual learning goals are clarified, 
established and executed. 

4. There is opportunity for distributed leadership. There is 
shared responsibility for planning, working out, and evaluating 
individual and group productivity. 

5. A balance between identification with the group and au- 
tonomy within the group evolves so that each individual feels 
that he is achieving his academic goals and at the same time is 
learning significant lessons about cooperative methods and 
about himself. These latter learnings about self and others can 
be achieved in the ordinary classroom if the teacher has the 
knowledge and skills to deal appropriately with the people as he 
deals with the subject matter. 

What docs a teacher do to achieve social and personal gains 
for his students while they are working and learning about a 
particular subject matter? How does he implement the criteria 
for groupness and at the same time carry out institutional, 
departmental and course objectives? 

The teacher should have certain knowledge. He should know 
his subject matter and know multiform methods of teaching his 
courses so as to be able to adapt to changing group capacities 
for learning. A teacher is often limited in his communication 
of vast stores of knowledge by a limited knowledge of methods 
of communication. He cannot develop sensible content objec- 
tives in guiding the group if he docs not know his subject field 
authoritatively. 

The teacher is methodologist as well as scientist in his field. 
The timing of the presentation of learning activities is de- 
pendent on his skill in continuously diagnosing groupness and 
readiness for action. Preparation of the group for responsible 
planning, action and evaluation demands skills in: 

(t) Assessing student expectations regarding the course at 
regular intervals. 

(a) Giving opportunity for acquaintance and participation in 
work groups small enough to do the work but large enough to 
insure socialization. Peer group management is one skill useful 
to the teacher to insure that the isolate learns too. 

(3) Teaching students how to work together through r 61 e 
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playing, experiments, demonstration, practicing various leader- 
ship roles, feedback of course content to the group, and through 
rearrangement of cliques. 

(4) Timing the reflecting of the projection of individual atti- 
tudes in group situations. The leader who responds only to 
individuals in a discussion-structured class invites coaction 
rather than interaction. Coaction often characterizes the non- 
directively led group. In advanced stages of acquaintance, 
attitude. reflection and interpretation is a powerful skill in im- 
plementing self understanding in the classroom interaction. 
Reflecting individual attitudes early in a course before the 
group atmosphere is secure is often devastating not only to the 
individual who has let his attitudes show but to the security 
of the class in relation to the teacher. Skill in identifying 
emotional reactions can be useful educationally if it is handled 
properly by the teacher. 

(5) Counseling with students who ask for it or who obviously 
need personal reorientation Teachers who make work projects 
meaningful social experiences find that students migrate to- 
wards them to relate significant personal reactions, problems, 
decisions and goals. Usually teachers earn this function through 
the combined processes of acquaintance and effort as discussed 
above, and as a result of the attitudes to he discussed below 
In later stages, teacher initiated counseling contacts are often 
appropriate. 

Basic to knowledge of subject matter and skills in developing 
groupness are certain attitudes which help to implement group 
productivity. The egotistical teacher, for example, cannot will- 
ingly distribute leadership ; and even if he does, the class usually 
reacts to his attitude by using the freedom to scapegoat him, 
to rebel, or to be absent. The methods described earlier demand 
a preoccupation with the group’s interests rather than with 
self. The flexible teacher’s attitude is one of respect for the 
capacity of the group to plan for, activate and evaluate its 
own efforts once the leader has implemented initial problem 
awareness, acquaintance, and practice in wording together. 
The maturity of the teacher demands that he limit the class 
when it violates institutional and departmental rules. He is 
the realist, the activator, the support, the servant. His role 
varies with the nature of the group and its capacity to assume 
leadership roles traditionally vested only in the teacher. 

Underlying the teacher’s methods are the learned feelings 
that he has towards himself and others. He uses the class to 
project these attitudes — just as the class is projecting on him 
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and the situation. Students can feel secure in personalizing 
reactions to course experiences and tonne another to the degree 
that the teacher is secure and to the extent that he provides the 
subject matter, knowledge, teaching skills and attitude-aware- 
ness to make the total learning experience social and useful. 
To the extent that he can sincerely and accurately verbalize 
self-relevant remarks of students in a secure, social-emotional 
setting of the work-oriented classroom, the teacher will be 
making his instruction guidance. 

In the half hour demonstration of the opening session of a 
class in Industrial Personnel Psychology at the conference, the 
flexibility principle was illustrated. 

The leader was an experienced industrial psychologist with 
twelve years of private industrial consulting work as a back- 
ground of knowledge. He was an expert in nondirective group 
leadership. Ilia attitudes arc perceived by most people as 
kindly, interested, friendly. In terms of knowledge and atti- 
tude he was satisfying ro the class of six graduate students. 

However, the class and the audience criticized the leader for 
his singularity of teaching method even though he did vary 
the traditional reflecting method by (i) introducing the class 
to one another at the outset, and (ii) directively searching for 
common purposes within the group. 

The nondirective leader failed to utilize various procedures 
that might have promoted learning: 

(t) lie did not write group purposes on the board as they 
were established through discussion. Knowledge of progress 
was slowed. The leader kept his own notes on group purposes, 
however. 

(2) He could have begun to distribute leadership by having 
a member of the class record group progress on the board and 
perhaps be responsible for reporting group thinking to the class 
when needed. 

(3) The class arrived quickly at objectives and seemed ready 
for implementation of goals. The leader allowed pauses to 
occur ( only reflected expressed statements, and did not clearly 
perceive this stage of group action. His reasoning on this point 
was that he is more interested in petting the group acquainted 
and feeling comfortable than he is in “getting somewhere” in 
the first class sessions. The debatable point is whether, in a 
work-oriented classroom, personal attitudes do not came to 
be expressed as deeply as m an attitude-oriented classroom. 

(4) One member of the class obviously was playing the critic 
r6le and could have been called on by the teacher to evaluate 
“how we are working together" at the times that the groun 
hogged clown. 
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(5) Another class member stood out as a down-to-earth, 
practical person who wanted to prod the group to action. At 
the one time that the group was ready to act, the teacher could 
have utilized him to lead the group at this point. Resistance of 
the leader in adapting his role to group needs seemed to hold up 
the class Reflected feelings at this point did not satisfy the 
class. 

(6) The nondirective method of reacting to individual at- 
titudes resulted in coaction of member with leader. The leader 
could have distributed leadership and insured interaction by 
having members practice verbalizing expressed viewpoints of 
other members. 

The above behavioral descriptions are but a few examples of 
the need for flexibility that appeared in thirty minutes of a 
simulated class which was led by a person who was supposed to 
be singular in his approach to group learning. 

Probably every class differs in the timing of acquaintance, 
in arriving at common purposes, in its expectancies regarding 
the work of the course, in its perceptions of the teacher, and in 
its capacity to learn to assume distributed leadership. There is 
no set pattern or sequence of procedures that will prove to be 
applicable to all class groups. In achieving the criteria of group 
productivity set forth in this paper, flexibility of knowledge, 
methods and attitudes seems to be a necessary assumption. 

Summary 

Flexibility is not a prescriptive or even a very helpful concept. 
Research on group process has not taught conclusively what is 
the best practice. In the writer’s opinion the certain points are 
(a) any singular method, e.g., lecturing, reciting, attitude re- 
flecting, or reading is not effective by itself, (b) the teacher’s 
knowledge of subject matter alone is insufficient, (c) singular 
attitudes, e.g., acceptance, do not alone describe the complex 
variables comprising the teacher’s roles and task; (d) classes 
demand flexible alteration of the teacher’s behavior if the locus 
of responsibility for action is gradually placed within the group 
itself. 



DIAGNOSTIC AND REMEDIAL MEASURES IN STUDY 

SKILLS 


BOYD B. JACKSON 

Clinical Counselor, Student Counseling Bureau, University of Illinois 

Most of the traditional attacks on problems of so-called poor 
reading and study skills place extreme emphasis upon differ- 
ences of efficiency and effectiveness of the mechanical factors 
influencing learning, 

I should like to propose a hypothesis which seems to be borne 
out by general clinical experience that even in fields of reading 
skills and study skills, factors of motivation and personality 
Structure are an the whole considerably more significant than 
the difficulties in mechanical procedures. 

This paper is devoted primarily to the philosophies and or- 
ganization of a program of diagnostic and remedial measures in 
study skills nowin operation at the Student Counseling Bureau 
at the University of Illinois. Although the program is still in 
the experimental stage, many encouraging trends are develop- 
ing. Its methods are unique, Its objectives are neither tradi- 
tional nor radical. 

A previously established study-skills program at the Student 
Counseling Bureau seemed to be providing many students with 
adequate study help. Traditional methods such as diagnostic 
tests, lectures, informative reading and supervised practice 
frequently boosted achievement to a higher level for that semes- 
ter. However, some students returned the next semester, again 
seeking help. After a short attempt to put the recommended 
methods to practice they had given up in a more or less neurotic 
fashion and returned to the original methods. They then re- 
ported, “I know why I failed; I didn’t know how to study.” 
This too-ready explanation suggested that failure provided a 
satisfaction of an unusual but real nature. 

Those who work with diagnostic and remedial measures in 
study skills with a clinical view will certainly recognize such 
reaction as not being entirely on an intellectual level 
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It follows that college students who complain of study diffi- 
culties may have causes for those difficulties much more deeply 
rooted than the individually claimed symptoms — causes that 
cannot be adequately diagnosed by the achievement tests com- 
monly used today. Despite the contention of one study-skills 
authority that “much of the difficulty at the higher levels 
results from improper learning or failure to learn earlier funda- 
mental processes,’ 1 he continues, saying that in corrective train- 
ing “the effect of unfortunate emotional conditioning persists 
for years and constitutes one of the major problems in remedial 
work at all levels.” 1 Mere lack of information of study methods 
is only infrequently a disabling factor. Actually, at the college 
level, it can seldom be considered the single causative factor 
for unsatisfactory achievement. 

College students have been exposed to the fundamental skills 
and knowledge of the primary and secondary schools. The effect 
of exposure to fundamentals in that formative period may later 
produce either satisfactory or unsatisfactory achievement, de- 
pending upon the dynamics of the motivations involved. Un- 
fortunately, little or no attention is given to the motivational 
factor at this level, as is evidenced by the simple directed 
recitation-learning used in high school and mentioned by so 
many university students seeking study help. Most deans or 
counselors have frequently heard the tearful wail, “. ..but 
the instructor didn’t say that was important, so I missed those 
questions on my final,” or “I just don’t know how to study for 
that course. The teacher lectures about something that isn’t 
even in the textbook — how am I to know what is important?” 

When we teach a person study skills at the college level we 
are teaching that person to work independently at maximum 
efficiency This unusual definition of study skills implies pur- 
poseful motivation as a requisite to achievement by way of 
skills. Almost every study manual has a short section devoted to 
motivation or emotional adjustment and they are frequently 
mentioned within the context of the remaining sections, but 
there are few if any provisions made for the possible correction 
of poor motivations or unfortunate emotional conditioning 
within study-skills programs. 

‘Pennington and Berg An Introduction to Clinical Psychology. New York: Ronald 
Press Company, 1948, p 1J4 (Robert M Bear). 
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Motivation, or emotional conditioning, is not necessarily 
aroused by diagnosing a student's short-comings and providing 
exercises or informative lectures to remedy his weaknesses. 
You are frequently aware of inefficiencies in your own methods 
but you do not change those methods just because someone 
suggests supposedly better methods. For this reason, undifferen- 
tiated wholesale instruction in study skills a panacea kind of 
teaching can hardly lie effective. Such methods are statically 
helpful in that a pupil remains in the role of a pupil, perhaps 
even a somewhat more efficient pupil. However, one aim of the 
college study-skills program is to help promote the individual’s 
growth from flic pupil-to-student stage in educational develop- 
ment, i.e., from a dependent passive recipient of information 
to an independent motivated user of that information, The 
mere acquisition of skills does not satisfy this function. The 
student needs to understand his own motivations for desiring 
this change before the change becomes, in effect, his. 

Such an orientation to study skills does not allow for an 
exaggerated emphasis upon one study skill and its correction, 
nor can such an orientation justify a hasty disregard for the 
student's present educational and emotional needs. Hence, a 
decision was made to try to work with these students in groups 
on a more basic level, involving basic motivations, using study 
skills as the locus around which the more fundamental problems 
might take shape. 

A permissive discussion group, without the distraction of 
classroom competition, seemed to offer the student an oppor- 
tunity to integrate the emotional and intellectual elements of 
learning. More specifically, the student was provided first, an 
opportunity to strengthen his present knowledge of study skills; 
second, an opportunity for emotional catharsis and integration 
through exploring and talking out his own personal and educa- 
tional problems; and third, an opportunity to narrow or widen 
his vocational and educational objectives by means of perti- 
nent information from those areas. 

To derive the greatest value from the group for the individual, 
the program was organized around the self-expressed needs of 
the students. These needs were first expressed during the initial 
interview and frequently restated or altered during the develop- 
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ing discussions within the group situation Obviously, it was 
necessary to select a starting point from among the varied 
problems and expressed needs of the individuals The leader 
took the responsibility for selecting the discussion question, but 
left it in the language of the student to permit as much individ- 
ual recognition and identification with the problem, as possible 
The problem, of course, had to be related in some manner to 
study skills to be pertinent to the situation This limitation 
would, on the surface, seem to be contrary to the original thesis 
of a permissive situation. However, such limitations do provide 
flexibility within wide limits and the opportunity for additional 
individual counseling outside those limits. Individual counseling 
was stressed frequently as a necessary adjunct of group work as 
it offered the individual an opportunity for acquiring new atti- 
tudes and motivations that he could put to practice with 
greater chances of success within the selected group. 

There were few precedents to follow in setting up such an 
extensive program Consideration had to be given to the always 
present criticism of group work — that it does not provide for 
individual differences. This was partially provided for in several 
ways. First, the groups were kept small enough to allow flexi- 
bility of action, second, a clinical diagnosis of individuals to 
increase homogeneity of problem factors within groups; third, 
a student-centered, permissive relationship was encouraged, 
emphasizing thestudents’ claimed problems instead of a teacher- 
determined goal; and fourth, provision was made for individual 
counseling for those who might desire or need it. 

A clinical diagnosis was necessary to provide as much group 
homogeneity as is feasible in a clinically oriented situation. 
The first selection was actually made by the students in that 
only those students were considered who came to the Counseling 
Bureau asking for study help. These students revealed some 
motivation by their very act of seeking help. For further group- 
ing purposes a battery of tests was administered that provided 
measures of general ability (the American Council on Education 
Psychological Examination) , interests (the K.uder or Strong 
Vocational Interest tests), personality (the Minnesota Multi- 
phasic Personality Inventory) , and reading {Cooperative Reading 
Comprehension ‘Test). As the use of test results in a blind diag- 
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nosis is a poor procedure at best, they became important only 
in relation to the clinical situation provided by a comprehensive 
personal data questionnaire and at least one individual inter- 
view. Such a screening method allowed classification into these 
general categories: (i) low ability — low achievement; (a) aver- 
age ability or better- low achievement and with evidences of 
personal and/or specific educational problems; and (3) those 
who seemed to need only study-skills help. 

This last group we will not he concerned with at great length 
in this paper as they were those university students more nearly 
in need of traditional study-skills help and seemed to be receiv- 
ing adequate remedial help, on this basis. 

Students seeking study help who, according to test results, 
have low ability and who have a consistent record of low 
achievement are not rare cases. The probation and drop lists 
of the various colleges are grim numerical evidences. With this 
group further instruction in study skills by the traditional 
lecture, recitation and practice methods with a brief glance at 
the clinical situation is absurd. On the other hand, these are 
failing students who need some kind of help. In their present 
state they are headed for continued failure and more serious 
adjustment difficulties. These students frequently state, “I 
spend so much time earning a *D’ in algebra that I fail my 
other courses." The trauma of always being near the bottom of 
the stack with the classification of “ unsuccessful” imprinted 
semester after semester is not generally conducive to the forma- 
tion of a well-balanced individual. These students, when placed 
in a competitive educational situation which makes them feel 
inadequate, tend to act emotionally rather than rationally. 
They arc desperately avoiding an acceptance of reality. They 
use all sorts of methods to avoid situations and responsibility 
for situations. A student who says, "I read so slowly I can’t 
finish my assignments,” is not necessarily asking for help in 
the mechanics of reading. This may be his way of saying “I am 
failing, but it’s not my fault, I can’t read fast enough.” Like- 
wise, the student who asks, “Will you teach me some better 
study methods?” may not really want study facts. He may want 
something tangible to use as a self-excuse for his failure, His 
reading or study” block” is impregnable so long as it is acknowl- 
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edged and treated as a mechanical difficulty. His responsibility 
easily becomes your responsibility. You are to blame if he 
does not get better grades because you did not teach him to 
read faster or to study better. Forcing the facts on him, no 
matter how subtly, does not insure that the student will accept 
the responsibilities of applying those facts to his daily living. 
He has lost a sense of personal responsibility and is in need 
of a modification of attitudes. 

Through group work and individual counseling such students 
become aware of their responsibility for their present situation. 
After a group discussion of attitudes concerning educational 
competition, interests, and previous poor grades in relation to 
future academic possibilities, they are frequently ready to face 
more squarely their present realistic situation. A feeling of 
self-responsibility evolves and tends to start the closure between 
a legitimate need and its realistic fulfillment. 

The problem is then frequently restated, “I’m sure I can 
succeed at something, but what?” This offers an opportunity 
to explore occupational and educational information, with a 
goal in view of helping the individual to select a more feasible 
role in society. 

The second general classification was those students with 
average college ability or better, low achievement records and 
with clinical evidences of personal and/or specific educational 
problems. This classification exemplifies a wide range of diversi- 
fied problems: from the perfectionist with volumes of neatly 
cross-indexed notes who cannot recall a thing with his notebook 
closed; through the chronic case of exam jitters who knows all 
and forgets all when he walks into the exam room; to the rebel 
who is happiest when he can get by and brag about not cracking 
a book. 

It is generally accepted that a student’s present behavior is 
but the expression of an accumulation of his past. Two stu- 
dents with dissimilar past lives frequently have quite similar 
problems. The mere similarity of problems cannot then justify 
using the same predetermined set of rules to help these students 

The lack of specificity of expressed causes of why students 
study the way they do frequently causes difficulty in helping 
the student find the source of his problem. 
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Two students seeking study help regarding a given difficulty 
frequently express different complaints. One is apathetic; one 
aggressive. One says, ”1 know what the authorities claim to be 
good study methods, but they don’t seem to work for me.” 
The other says, “1 know what the authorities claim to be good 
study methods, but I don’t seem to want to do anything about 
them and 1 dislike studying anyway." 

Explanation, exhortation, disapproval, suggestion or any 
other intellectual technique of teaching leaves little permanent 
impression on students in such situations. Teaching of this sort 
has evidently not been accepted before. What reason is there to 
assume that it will he now? The basic difficulty lies again in the 
attitudes, emotions and motivations behind previous and pres- 
ent learning. Therefore, the techniques used to remedy the 
situation must be related to study methods, but only as study 
methods are influenced by motivation and general behavior 
dynamics. This necessitates a flexible and varying technique 
since the motivational situation differs with each student within 
the group. 

The pcrmissively structured group-counseling situation, sup- 
plemented by individual counseling when desired, seemed to be 
the only technique that met those requirements. 

To select a problem for discussion that affected all of the group 
in some manner was a difficult step, hut a necessary one. A prob- 
lem once chosen was easily made significant by the student’s 
own personal experiences, arbitrary opinions, or opposite views 
and reported facts, and led to a discussion of study methods as 
well as to the motivations behind those methods, 

A clarification or elaboration of attitudes or points of view 
gave ample opportunity to examine and evaluate possible solu- 
tions to problems. At no time was an agreement reached on any 
one solution, but by always providing a summarization that 
could be of help to each student, individual solutions were more 
easily recognized and accepted. Major emphasis was placed on 
clarifying questions and arriving at decisions more acceptable 
to the student and to the group. 

The program as outlined does not demand a rigid diagnosis 
of study skills nor a rigid program of remediation. This program 
cannot be equated with traditional teaching as the emphasis 
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is placed on developmental learning of new habits based on ad- 
justive education or relearning, rather than on an authoritative 
dispersal of information and drill. 

Such a program follows the basic postulates of counseling 
in that it starts to work on the student’s problem as he sees it, 
but provides ample opportunity for treatment of areas parallel- 
ing or not directly related to the claimed problem Such a pro- 
gram is advantageous in that it permits a treatment of the 
student as a whole human being. 

In evaluating the work to date we find that individuals 
participating in discussion groups of this sort report signifi- 
cant increases in grade averages; significant increases in reading 
speed and comprehension have been found by a test-retest 
method, and a retest on the Minnesota Multiphasic Personality 
Inventory indicates generally fewer and less extreme devia- 
tions on the Depression and Hysteria scales. 
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Mr at Kdutmion, Columbia University 

St udkkta are admitted to a particular college on the supposi- 
tion that they have'Svhat it takes’* to succeed. But it frequently 
turns out that they do not succeed -at least, not without help. 
They flunk out. The generally high mortality in the freshman 
year is detrimental both to the student and to the college. The 
experience of failure undermines the student's self-esteem; it 
also represents a financial loss to the college. Something is 
wrong with the admissions policy, with the orientation program, 
with the counseling service, with the curriculum or instruction, 
or, most likely, with a combination of these and other factors. 

The causation of students’ failures in college is complex. 
This is true of failure in academic work; it is even more true of 
the broader concept of college success and failure presented by 
Hale in his study of the transition from high school to college. 
This article, however, will be focused on failure to carry college 
subjects rather than on failure to achieve the all-round personal 
development to which a college education should contribute. 

Actually the different aspects of college success are interre- 
lated. The causes of failure in college subjects are found in the 
total pattern and atmosphere of college life as well as in the 
preparation, attitude, and ability of the individual student. 
Failure is a resultant of hereditary and acquired predispositions 
responding selectively to the stimuli of college life. 

The general approach to students’ failures in college subjects 
includes three main features: 

t. An accurate description of the difficulty: In what way is 
the student failing? , 

a. An inquiry into the multiple causes: Just why is he fail- 
ing? 

1 Excerpts from * paper wad at a Joint meeting of tho American College Personnel 
Association, Thursday, April ar, 194P. Chicago, Illinois. 
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3. An attempt to correct the conditions that seem to be 
giving rise to failure. 

Description of the Difficulty 

It is the responsibility of every teacher to make clear to the 
student wherein he has failed to meet the requirements of the 
course Psychological experiments have shown that persons do 
not improve if they are ignorant about how much or how little 
progress they are making. One does not improve in a subject if 
his practice in it is not accompanied by instruction and by a 
knowledge of the results of his practice Very rarely in college 
is an analysis made of achievement in a subject, though this 
kind of analysis would be most helpful to the student. For ex- 
ample, success in a course in Freshman Composition might be 
broken down into the following components: 

Ability to use correct grammar 

Ability to punctuate correcdy 

Ability to spell the words used 

Ability to construct paragraphs that have unity, coherence, 
and emphasis 

Ability to achieve similar unity, coherence, and emphasis in 
the composition as a whole 

Ability to use precise, vivid words in place of “empty,” 
hackneyed words and phrases 

Originality and creativeness in the content of the composition 

Ability to catch and hold the reader’s interest 

Promptness in handing in assignments 

Contribution to class discussion 

A similar analysis of each subject, showing the points at which 
the student has failed to meet the requirements, would be a 
useful first step in dealing with failure. Such check lists could be 
supplemented by more detail about the specific kinds of errors 
the student is making, and could contain suggestions for over- 
coming them. If a teacher fails a student in his subject, he 
should be able and willing to show him exactly where his 
failure lies. 

Causes of the Failure 

Although some of the causes of a student’s failure in a sub- 
ject are suggested by an analysis of the failure, the real and 
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determining reasons usually lie deeper. The cumulative student 
personnel record throws further light on possible causes of 
failure. Read as a whole, with this particular educational gui- 
dance problem in mind, the cumulative record may reveal 
conditions that arc giving rise to failure. One record may show 
generally low ability in high school, and in intelligence and 
achievement tests, thus indicating the need for a lightened pro- 
gram, extension of the college program over five years instead 
of four, or the election of subjects that do not demand the 
highest quality of scholastic aptitude. Another record may show 
a marked discrepancy between achievement and intelligence 
as measured by standardized tests. It may also .show a heavy 
load of part-time work, excessive participation in student ac- 
tivities, or long and frequent week-ends at home. In short, 
many clues as to the causes of lailure may be obtained from the 
records already available. These clues should he further ex- 
plored in the initial interview with the student— usually the 
most important means of understanding the real causes of his 
failure. 

In the first interview with a student failing in one or more 
subjects, it is important for the counselor to convey the con- 
viction that the student has resources within himself to under- 
stand and to do something constructive about his failure. The 
counselor may present the failure as an opportunity for the 
student to learn not to fail that way again. The student should 
he encouraged to speak frankly and freely, using the counselor 
as an immediate incentive to achieve a clarification of the prob- 
lem. 

In the following case the initial interview seemed to have 
been successful in helping the student to analyze his situation. 
Ted had managed to get into college after his applications had 
been rejected by several institutions. His scholastic aptitude 
according to the tests given entering freshmen was approxi- 
mately average for the group. All of his freshman marks at the 
end of the first semester were failing or on the borderline, His 
faculty adviser thought he needed help in "getting down to 
work and remembering what he has learned.” Perhaps his 
poor marks were the result of too many good times, of poor 
study and reading habits, or both. The faculty adviser re- 
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ferred him to the Reading Center. These are a few excerpts 
from the first interview (typed from stenographic notes) : 

Worker: Suppose you tell me why you are here 

Student: Well, Professor M thinks I need help with study 

habits and with reading. 

W. How do you feel about your reading and study habits? 

S. I never thought there was anything wrong. I thought I was 
perfect — except that I never studied, really I just let 
it go by. My average was 75 when I graduated. But in the 
seventh grade I was seventh highest in an IQ test — the 
teacher told me. She said I could really do the work if I 
wanted to But I never did. 

W. How do you account for your not studying? 

S Well, I don’t want to blame others, but really, no one ever 
taught me to study, and so I never put my mind to it really 
I just spent time with the fellows and friends. . . 

Later near the end of the interview, after the student had sat 
quietly for a few minutes, the worker said. 

What are you thinking? 

S. I guess I really don’t know where I’m heading. I still think 

I like art, but I’m not sure. The struggle for jobs in that 
field is tough. I’m not sure I’m good enough. I know my 
Dad would like me to take up his business. Though, when I 
was looking for a job, he didn’t ask me to work for him I 
went out on my own. I don’t like working for him . . I 
told him, though, I could try his business and see how I like 
it. 

(The time was up and the next appointment was ar- 
ranged ) 

This initial interview suggests that the student had some 
emotional resistance to school achievement, and lacked a sense 
of direction and a motivation for college work. There seemed to 
be a conflict between the student’s own interests in English 
and art and his father’s insistence that he take a practical course 
leading to business. In this first interview the worker learned 
something about the student’s oral and silent reading pro- 
ficiency, his interests, his vocational dilemma, and his conflict 
about choosing a vocation The student also gained some help 
on reading paragraphs of the sort of material he must mastei 
in college. 

The interview on reading and study difficulties, whether a 
single contact or a series of conferences, usually follows this 
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general pattern: (s) the student, in a permissive, encouraging 
atmosphere, thinks through what the failure means to him ahd 
how it came about; (a) after he has expressed his feelings about 
it and is trying to understand it, he welcomes help from the 
counselor in interpreting his feelings and seeing relations among 
different factors in the situation; (3) having gained some in- 
sights, he tries to determine what his next steps are to be; and 
(4) he leaves the interview with a plan of action in the carrying- 
out of which he feds he will have the interest and support of 
the counselor, to whom he can come for further help if he needs 
it 


Paths to Improvement 

If the counselor has been successful in helping the student 
take an initiative toward solving the problem of his failure 
and the student has, through “talking it out,” found what he 
believes to be the condition that is causing his failure, the 
student is ready to start work on correcting that condition. At 
this point, the counselor must be ready with specific resources 
to aid the student, If it seems clear that he needs a lighter pro- 
gram, modifications in the student’s long-term educational plan 
must be made and approved. If the student is convinced that 
he would succeed if he could acquire more efficient reading and 
study methods, provision for such practice and instruction 
should be made. If he has a deep-seated sense of futility about 
the meaning, use, and purpose of a college education in general 
and especially of the subjects in which he is failing, he may be 
helped by counseling or by small group discussions that clarify 
the purpose of life, the relation of his vocational choice to life 
as a whole, and the possible contributions that his subjects may 
make toward his self-fulfillment. If his scholastic achievement 
seems to be blocked by emotional difficulties, psychotherapeude 
counseling is indicated. 

In working with college students who for various reasons are 
not making good in college, the counselor has the following 
responsibilities: 

1. To encourage each teacher to describe the factors likely 
to cause failure in his subject. 



GENERAL DIAGNOSIS OF STUDENT FAILURE 


549 


a To use all available personal data for clues by which to 
chart the constellation of causes for a student’s failure 
3 In interviews, to create an atmosphere which will free the 
student from constraint and stimulate him to try to get at 
the roots of his failure. 

4. To make available to the student the resources he needs in 
order to carry out his plans for improvement. 

This approach to the problem of scholastic failure is es- 
sentially student-centered. However, it uses the cumulative 
record and other objective information and makes available to 
the student all the relevant resources of the college and extra- 
college services which he may need in order to become a better 
student and a better person. 



QUESTIONS FREQUENTLY ASKED CONCERNING 
READING INSTRUCTION AND MEASUREMENT 
OF READING SKILLS AT THE COLLEGE LEVEL 

FRANCES UUM.IXl) THU, (IS 
Chairman, Committer on Hijgrtosiic Reading Tests, Inc 

1. What arc the ways in which reading disabilities can be 
discovered before grades are available to suggest their pres- 
ence? 

a) Scores on a screening or survey test in reading which has 
as low? a correlation as is possible with scores on scholastic 
aptitude tests. Consideration should be given to making 
special help available to all students whose scores on 
such a test are at a stated percentile or below (depending 
on the facilities available for remedial help). This per- 
centile point (using entering college freshmen norms) 
might be the thirty-fifth, the twenty-fifth, the fifteenth 
chosen arbitrarily the first year. The point chosen arbi- 
trarily the first year should be evaluated during that 
year to determine: (U to what extent facilities of the 
school can furnish aid to these students; (a) to what 
extent they improve when given special reading instruc- 
tion; (3) how many remain in school after the first year. 
In the light of such evidence, the criterion for special 
reading instruction may be varied the next year. 

b) The ability of students to handle verbal symbols as 
compared to their facility to handle numerical or quanti- 
tative symbols. This comparison may be made from 
scores on such a test as the American Council on Educa- 
tion Psychological Examination (Q & L scores), or the 
College Flntrance Examination Board Scholastic Apti- 
tude scores. If such scores are not available and scores 
on a so-called Mechanical Aptitude “Test are, they may 
be compared to scores of general comprehension on a 
survey or screening test in reading. Another wav some 
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information of this nature may be obtained, is from scores 
on a clerical test such as the Minnesota Clerical Test. If 
the score based on use of words is much lower than the 
one based on numbers, it is probable that the student 
could profit from formal training in reading; and there 
is a good chance that the difficulty will be his method of 
approaching new words, i.e., the ability to sound letter 
combinations, to divide words into syllables, to recognize 
meanings of prefixes, suffixes, etc. 

c) Dr. Robert M. Bear of Dartmouth makes a very practical 
suggestion He states that if, when reading orally, a 
student reads less than 150 to 200 words per minute, 
(assuming no emotional involvement is present) it is 
likely that his reading skills will hinder him in his 
college work and that the disability will again be in the 
area of word recognition and word attack. 

d) By helping all faculty members to isolate and to refer 
those students who do not have the basic reading skills 
necessary for efficient, independent study of the basic 
sources being used in any class The best way I know of 
doing this is to note the difference between the verbal 
response or discussion made by a student to concepts 
discussed in class, as against his responses made in quiz- 
zes over textbook assignments, the material for which 
he should have gained largely by outside preparation 

How shall the teaching of reading in college be approached? 
It is not possible to give a complete and final answer to this 
question within the confines of this manuscript The follow- 
ing suggestions can be made 

Those of us who are interested in the field of reading have 
coined certain by-words which have come to mean some- 
thing to us. I would like to stop here and give a working 
definition of these so that I may use them freely. 

“Every teacher a teacher of reading ” To me that means 
aiding a student to survey the reading problem he is faced 
with at the moment, aiding him to choose the reading 
approach most appropriate, and to use it. It has long been 
an accepted fact that during about the first six years of 
schooling, children are establishing reading skills: building 
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their general sight vocabularies, attaining facility with skills 
required to get meaning from new words, learning how 
to use grammatical construction when they read, and other 
related skills. Even if these skills are well established, their 
application to many and varied types of situations has 
not become automatic, nor will it until students have used 
them throughout the lengthy gamut of specialized reading 
materials presented to them in the process of formal educa- 
tion. Therefore, the teaching of reading never stops: all 
teachers must be teachers of reading. 

"Developmental reading program" means this process 
of formal, planned reading instruction is done by every 
teacher of every subject at every level of education and in 
every class room, to aid students to choose and to use the 
reading skills most appropriate to the reading situation at 
hand. 

The word “remedial" may be used in its generic sense, 
derived from the verb “to remedy." However, when used to 
distinguish "remedial" from “corrective” reading instruc- 
tion, it has a more limited meaning. Reading disability 
cases may be grouped according to the degree of deficiency 
as: inefficient readers, corrective cases, and remedial cases. 
The inefficient reader usually has satisfactory reading skills 
but does not know how to apply them without reading in- 
struction, Such instruction is given in the developmental 
reading program by every classroom instructor. In correc- 
tive cases some reading skills are lacking but usually only 
those that can be supplied without a great deal of difficulty, 
though the student must also be taught to use them ef- 
ficiently through developmental reading instruction. Correc- 
tive reading may often be given through the use of "self- 
administering” manuals after an adequate diagnosis and 
discussion with the student have enabled him to understand 
the extent of his deficiencies. In remedial cases the individ- 
uals lack even the basic skills of word recognition and the 
instruction usually becomes a much more technical problem 
and is of a more complicated nature. Such instruction 
probably can best be handled through clinical work instead 
of through the regular developmental program in reading. 
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a) Now to answer our question: “By whom and how shall 
the developmental reading program in college be earned 
on?” It is expected that the developmental reading pro- 
gram of any college will be carried out by all faculty 
members. By its very definition it must be so. Students 
will never come to college so equipped that they will 
not be faced by new learning situations, and reading is a 
tool of learning. Professors are constantly seeking ways 
of giving reading instruction in the classroom — a part 
of any efficient classroom instruction. This goes farthei 
than words as tools also, it is a part of teaching in that 
concepts themselves once met and understood from dis- 
cussion in the classroom, can be efficiently approached 
through reading; but they cannot be so approached unless 
this “readiness” is established Thus, the classroom period 
becomes a place, not to repeat what the textbook says, 
for that can be read by any student well prepared by 
the classroom process of establishing “readiness,” but for 
discovering and building concepts and “sets” which make 
independent preparation outside of class a rewarding 
experience. Again, it should be remembered that we are 
teaching individuals in a group, not a group of students, 
and we succeed in our task only as these students become 
less dependent upon classroom instruction; for the time 
will come very shortly when most of their learning will 
be done along avenues of their own choosing and on their 
own with little formal instruction. We as college teachers 
are not so much teaching the final unalterable facts in any 
field of learning as we are introducing students to con- 
cepts, laws, and terminology on which they can base 
further independent learning. Efficient use of reading 
skills, appropriate to any content field, is one assurance 
that the student can continue his learning in that field 
when he is no longer in the classroom. We must remember 
that a democracy is self-governing, that, ideally, every 
individual in it should make his contribution to that 
governing process to the extent of his ability to under- 
stand. He can do so only as he has tools with which to 
increase his background of knowledge independently on 
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any issue that arises, using materials which he can com- 
prehend as a basis of his learning. An example: the 
Marshall Plan, the Western Alliance Pact, the E.C.A. 
or the Taft-Hartley Bill are all issues before the current 
Congress which have far reaching social import. It is 
true that the understanding which the college graduate 
and the cab driver can develop, and the sources from 
which they learn of these issues need not be the same, 
but unless what they think concerning these issues and 
thus what they do about them as citizens is going to be 
the result of the dictation of some party leader, they 
must have skills, and '‘set*' or motivation to learn about 
them. Reading is the probable basic tool they will use. 
Both the college graduate and the cab driver went to 
school. Do they have the reading skills necessary to 
profit at the level of their own ability from efforts to 
learn aliout these social issues as independent learners? 
Can they not read the newspapers (notice I did not 
say "a newspaper"), the Public Affairs pamphlet on the 
subject? That is important just as surely as it is important 
to see that the scholar who is to continue in our uni- 
versities until he gains the highest recognition offered — 
the Ph.I). degree has efficient skills for further learning; 
for it is he within his lifetime who will extend our knowl- 
edge, and the world without him would be static. We 
must sec that he is not handicapped or cramped in any 
way in making his very important social contribution, 
b) And what of the corrective program? 

We have said then that developmental reading, the de- 
velopment of efficiency in using reading skills already 
established, shall, ideally, be done by the professor in 
the classroom. By whom, and how, shall corrective and 
remedial reading instruction be given? (I am not even 
going to stop to argue the point that it must be done. 
Because a car should have been fully equipped when it 
came from the sales room, because its motor is inefficient 
when delivered, docs not mean that the buyer must al- 
ways use it in its inefficient state; but rather he should 
take the steps necessary to make it efficient.) 



MEASUREMENT OE READING SKILLS 


555 


By very definition, corrective and remedial instruction 
to be done efficiently must be preceded by determining 
what skills are lacking. Testing and observation are the 
techniques by which this can be done. It cannot be ex- 
pected that all of the professors in the classrooms can 
make such diagnoses for individuals Therefore, as soon as 
it is apparent that a student’s learning is handicapped by 
poor reading skills, the professor should be able to refer 
the student to a clinician who, in addition to being a 
psychologist, understands the psychology of reading and 
knows how to diagnose disabilities in this field. Much 
of the corrective work can be done in the classroom in 
combination with special help from the clinician and 
carefully guided outside work on the student’s part. The 
clinician should give the professor clues as to the type of 
classroom work which would be most helpful to the 
student, and then make frequent requests for signs of 
progress seen by the professor as well as reporting prog- 
ress being made in the clinic. 

If the student needs carefully planned remedial instruc- 
tion, he may not be able to profit from certain classroom 
instruction until remedial instruction has gained head- 
way Therefore, the recommendation may be made that 
he drop certain courses, give attention to remedial and 
corrective instruction, and register later in courses re- 
quiring the application of those basic skills, 
c) Shall corrective and remedial instructions be given in 
groups or must they be individualized? 

Generally I think it can be said, the more serious the 
disability, the more likely it is that the first instruction 
should be individualized to the specific needs of the 
student. But if at the beginning of such instruction a 
careful plan is made and exercises are set up to develop 
the skills which are lacking, the student need not take 
the full time of the clinician while he works on the exer- 
cises. Other students working on their individual prob- 
lems according to the plans set up to aid them in develop- 
ing their needed skills, may work in the same room 
together. The clinician in this case is not only a specialist 
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in reading, Hut a. specialist in teaching, aiding the student 
to keep up his motivation, noting and preventing frustra- 
tion in the learning situation, and guiding transfer of 
the skills to the classroom and textbook situation. The 
aim »s for each student to He as independent a learner 
as possible. Therefore, the clinician can most efficiently 
use his time, as well as help students, by aiding only where 
necessary and, as much as possible, by leaving the re- 
sponsibility for learning to the student himself; but main- 
taining an atmosphere in which this learning can most 
efficiently take place. 

d) Shall credit be given for corrective and remedial instruc- 
tion? 

Remembering that the crucial test is whether the stu- 
dent becomes a more efficient learner, this question be- 
comes important only as it aids in administering the pro- 
gram. If the cost must be shown to be covered in the 
budget, and students pay for instruction by points, then 
to give it credit does not seem to violate any important 
principle of college administration. This is especially true 
when we remember that, if successful, this is probably 
some of the most important learning a student will do 
throughout his whole college career, More important here 
is that if he is given credit, then this work will probably 
be placed with other courses in a time schedule, recogniz- 
ing the fact that it does take time. Far too often, the work 
fails because a student, handicapped already by inef- 
ficient reading skills, is further handicapped by adding 
to the load he is expected to carry, 

3. Can a reading program be carried on in college without a 
specialist in reading? 

I would say the answer is, yes — a part of it can ; all except the 
remedial aspects and the special help to professors to isolate 
reading problems in their own fields, if a psychologist who 
thoroughly understands testing and interpreting tests can 
help students find self-administering manuals to follow. The 
psychologist and the professor should also study the manual 
and give special help to the student where necessary. In 
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such a case, the help of the professors with whom he is 
carrying course work, will aid m insuring a transfer of the 
skills so learned to the content fields It should be recognized 
that this is not the ideal, however, and should be supple- 
mented if possible by consulting help from a psychologist 
who is also a specialist in reading. 

How can professors be aided by the specialist in reading so 
that they can become teachers of reading as well as of con- 
tent material? 

The answer to this question has seen suggested Special 
reading problems exist in all content fields. The professor is 
aware of them, but does not always know how to make the 
students aware of them. This the reading specialist can 
help him with. Also he may recognize but not have time or 
know how to give a student lacking certain skills the help 
he needs. Such a student he can refer, verify his own impres- 
sions, and get suggestions for helping him Free transfer of 
information, including progress reports on individual stu- 
dents and suggestions for classroom help by the professor 
according to the student’s individual needs, is a most im- 
portant aspect of a constructive relationship between the 
professor and the reading clinician. 



PRESENT POLICIES ANI> FUTURE PLANS OF COL 
LEGE GUIDANCE CENTERS OPERATING UNDER 
V. A. CONTRACTS- A SURVEY OK THE AMERICAN 
COUNCIL ON EDUCATION 

MlTCHEl.l, DREE.SE 

fVnfc' wir «f Educational P-vihtilngVi (,'eorge Washington University 

As early as March, 1945. some months before V-E Day, the 
Veterans Administration published in Occupations , The Vo- 
cational Guidance Journal a statement of their preliminary plans 
f ‘to provide counseling and guidance services to veterans, both 
the disabled and any others who desire and who are entitled to 
such services, at an adequate number of college centers, so 
located as to be convenient to veterans’ homes.” It was de- 
cided to locate such centers at the colleges and universities of 
the country for the reasons that these institutions "(1) usually 
have on their stalls persons who are skilled in the administering 
of educational or vocational tests and measurement and the 
various kinds of counseling; fa) generally are equipped to 
provide space and accommodations for the counseling proce- 
dure as well as the necessary dormitory and boarding facilities 
for those who come to receive counseling.” 

Additional reasons for establishing V. A. Guidance Centers 
on college and university campuses were set forth by Dr. Ira 
Scott in a talk before the American Federation of the Physi- 
cally Handicapped at the National Press Club, Washington, 
D, C., on April 18, 1945: 

The plan for providing complete and thorough counseling 
service to veterans by establishing guidance centers in cooper- 
ating colleges and universities utilizes the services of qualified 
counselors and thus gives to veterans the best service the 
country has to offer now; it enables these counselors to improve 
their techniques through practical service; it offers them an un- 
usually practical setting for training other counselors; and it 
furnishes the personnel in institutions of higher learning an 
exceptional opportunity to come to know and understand the 
feelings, the aspirations, and the everyday problems of the re- 
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turning veterans. This should result in more effective future ser- 
vice by such institutions , not only to veterans but to other students 
and to other citizens who may be interested in the permanent im- 
provement of adult counseling services in their own communities . 

Thus, the Veterans Administration College and University 
Guidance Program came into being. By i December, 1948, 415 
such centers had been activated, or one for approximately 
every four colleges and universities in the U S. By 1 March, 
1949, it is estimated that 1,000,000 advisements had been pro- 
vided for veterans in the college and university V. A. Guidance 
Centers. 

By December, 1948, the program which has mushroomed 
through a four-year period had begun to decrease in size as the 
number of veterans needing testing and vocational counseling 
began to decline. Of the 415 centers which had been in opera- 
tion, 105 or 2^ per cent had already been deactivated, and it 
was anticipated that the deactivation rate would soon be ac- 
celerated. It seemed to be an appropriate time to take stock 
and to try to ascertain to what extent Dr. Scott’s hope, ex- 
pressed in his talk of April 18, 1945, of stimulating colleges and 
universities to provide more adequate testing and vocational 
counseling services, not only to veterans but to other students 
and to adults in the community, had been realized. 

The speaker approached the American Council on Education 
in regard to such a study and was offered the necessary support 
and cooperation to make it possible. An Advisory Committee 
consisting of the following was established to review the pro- 
posed plan of investigation and to assist in an advisory capac- 
ity in the conduct of the study. Dr. A. J. Brumbaugh, Dr. 
Robert H Mathewson, Miss Phoebe L. Overstreet and Mrs. 
Janet S. Kirshner. The V A. has been most cooperative in sup- 
plying all requested information and data, but since the inves- 
tigation was, in a sense, an evaluation of V. A. influence, it 
was decided not to include V. A. personnel on the Advisory 
Committee. 

On 1 December, 1948, at the time this study was begun, 415 
V. A. Guidance Centers had been activated under the auspices 
of educational institutions. Of this number, 310 or 75 per cent 
were still in operation, 105 or 25 per cent had already been 
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deactivated. Thirty-six per cent of these Guidance Centers 
were Plan A Centers in which the institutional personnel did 
both the testing and the counseling*, 4,3 per cent were Plan 
A-B Centers in which the institutional personnel did both 
testing counseling arul testing only for cases which were coun- 
seled by V. A. personnel; ni per cent were either Plan B 
Centers in which the institutional personnel did testing only 
or Plan C centers in which V. A. personnel did both the testing 
and the counseling and the educational institution provided 
only the physical facilities. It was decided to limit the study 
to Plan A and Plan A-B Centers so as to include only centers 
in which the counseling service was provided by institutional 
personnel. In the selection of centers for inclusion in this study 
the following additional criteria were established: (1) The Cen- 
ter must have been in operation for at least two years, (a) 
The Center must have been in operation as late as June, 1948. 
It was felt that unless the Center had been in operation for at 
least two years, it hail nor had a reasonable opportunity to 
demonstrate its values and defects. Centers which had closed 
their doors before June, 194K, were not included because we 
doubted if qualified personnel would still be on the scene to 
answer the questionnaires. 

Of the 327 Plan A and Plan A-B Centers which had been 
activated, 84 were eliminated under the provisions stated above, 
leaving 243 Centers to be contacted for purposes of the study. 

The following letter was sent to the presidents of the col- 
leges and universities at which the V. A. Centers were located: 

My dear Colleague: 

During the past four years approximately 388 colleges and uni- 
versities have cooperated with the Veterans Administration 
in operating a Veterans Guidance Center. In many instances 
the services of the Cencer have been available not only to vet- 
erans under the Veterans Administration contract but to stu- 
dent non-veterans and to clients from the community. Now 
that the influx of veterans is diminishing, the number of_ Cen- 
ters operating under Veterans Administration contracts is be- 
ginning to decline. Many college and university administrators 
are now confronted with the problem of determining future 
policy with respect to the testing and vocational counseling 
services formerly maintained with Veterans Administraton 
financial support. 
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The survey is designed to determine the present status of the 
counseling service provided at educational institutions under 
the Veterans Administration program with particular reference 
to whether these institutions are considering plans for con- 
tinuing such services and, on the basis of the impetus provided 
by the Veterans Administration program, to furnish such serv- 
ices to students and the community-at-large. Itis believed that 
administrators in higher education will find it helpful to know 
something about the experience and future planning of the 
various institutions confronted with the same problem 

The enclosed questionnaire consists of two parts: Part I calling 
for factual information which may well be referred to the Direc- 
tor of the Guidance Center or other administrative officer who 
has access to the statistical data required; Part II calling for 
an evaluation and statement of probable future administrative 
policy. Obviously the latter can be answered only by the college 
or university official who will be responsible for recommending 
or establishing future policy. Replies to Part II will be kept 
strictly confidential and will be used only in computing overall 
policy trends. They will not be revealed to the public or even 
to members of your own staff. For convenience in filling out the 
questionnaire, Parts I and II may be separated and later re- 
assembled for return. When you return the questionnaire, 
please attach copies of any available studies showing the effec- 
tiveness of the testing and vocational counseling provided by 
your Guidance Center. 

In return for your cooperation we shall make available to you 
a summary of the findings This study is being conducted under 
the direction of Di Mitchell Dreese who is on sabbatical leave 
from The George Washington University as Professor of Edu- 
cational Psychology and Dean of the Summer Sessions. I am 
sure Dean Dreese will be pleased to answer any specific ques- 
tions you may wish to raise concerning this study. In order 
that the survey may be tabulated in time to be of greatest 
value, we should appreciate having your questionnaire returned 
not later than January 15, 1949 The questionnaire should be 
mailed to The American Council on Education, 744 Jackson 
Place, N. W , Washington G, D. C., Attention: Dean Mitchell 
Dreese, Director of Study. 

Sincerely yours, 

A. J. Brumbaugh 

Vice President 

I shall not bore you by reading the questionnaire itself but 
shall refer to many of its items later as we consider the respon- 
ses to them. In general, Part I of the questionnaire was con- 
cerned with two types of data: (i) Identifying data concerning 
the institution for purposes of classification, such as the type of 
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institution, the location, enrollment, average number of coun- 
seling cases processed per month, etc. (a) Current administra- 
tive policies and practices within the Center. These policies and 
practices will he summarized later. Part II of the questionnaire 
was designed to ascertain future administrative plans for the 
testing and vocational counseling services provided by V. A. 
Guidance Centers. In brief, the College or University President 
was asked to indicate by an appropriate check on the question- 
naire what he planned to tin with the Guidance Center when 
the V. A. contract was no longer in cflfcct.There were three 
major possible replies with many qualifying sub-statements 
under each: (1) “Continue it essentially as at present,” (a) 
“Discontinue the Center,” and (3) “It is impossible to say 
at the present time what will he done with the Center.” After 
the President had stated his intention with respect to the 
future of the Center, he was asked to check a series of possible 
statements setting forth the considerations which motivated 
his expressed decision. These considerations were arranged in 
three groups pertinent: to the three courses of action referred 
to above, and the group to he checked by any particular presi- 
dent would depend upon whether he was planning to continue 
the Center, discontinue it, or was uncertain at the present time. 
Part II also contained fifteen statements concerning the possible 
influence of the V. A. Guidance Center on the student per- 
sonnel program with requests for appropriate checks, regardless 
of the future plans for the Center. 

All of the sections of the questionnaires contained spaces 
to fill in additional reasons and comments as desired so that 
the repertoire of responses was not necessarily limited to the 
statements on the questionnaire. It was deemed necessary to 
utilize a plan of controlled responses so as to insure attention 
to major considerations and to facilitate coding and tabula- 
tion of replies. From the 143 questionnaires mailed, replies 
were received by 1 February, 1949, from 164 institutions, 
of which 154 or 63 per cent were used for purposes of tabulation. 
Ten replies had to be discarded because only one part of the 
questionnaire was returned or the educational institution re- 
plying proved to be a secondary school rather than a collegiate 
institution, Twelve replies were received too late to be included 
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in the study, but a sampling check of their replies indicated that 
these late returns would not change the results 

The institutions whose questionnaires were included in this 
study are classified in Table i. 

Of the number replying, slightly more than two-thirds were 
public institutions and one-third were private colleges and 
universities. Of the total number, approximately half were 
universities, one-fifth liberal arts colleges, and roughly one- 
tenth each from the professional-technical, junior colleges, and 
teachers colleges. 

The geographic distribution of the colleges and universities 
sampled may be summarized as in Table 1. 

It is regrettable that replies are not available from 79 in- 
stitutions which had V. A. Guidance Centers meeting the 

TABLE i 


Classification of Colleges and Universities Whose Questionnaires Were Included in Study 


Type of Institution 

Public 

Number Per Cent 

Private 

Number Pei Cent 

Total 

Number Per Cent 

University 

47 

3° S 

27 

17 s 

74 

48 O 

X.iberal Arts College 

is 

9-7 

15 

9 7 

30 

19 4 

Professional or Technical 

II 

7 1 

6 

3 9 

17 

II O 

Junior college 

IS 

9 7 

I 

0 7 

16 

IO 4 

Teachers College 

17 

31 O 

O 

0 

17 

II O 

Total 

10 S 

68 1 

49 

31.8 

154 

99.8 


criteria of this study. It is believed, however, that the popula- 
tion sampled, 63 per cent, represents a cross-section of the 
total V. A Guidance Centers. Of the total to whom question- 
naires were sent, 89 per cent were still in operation; 11 per 
cent had been deactivated. Of the Centers replying, 90 per 
cent were still in operation; 10 per cent had been deactivated. 
The similarity of 89 to 90 and 11 to 10 is striking. 

The sampling of 63 per cent is somewhat higher than the 
response usually secured by the American Council on Education 
on questionnaire surveys of colleges and universities. 

As stated previously, Part I of the questionnaire was con- 
cerned with present practices of V. A. College and University 
Guidance Centers. The data revealed that the median number 
of cases processed per month during the total period of opera- 
tion was 70 as compared with a median of 56 f° r the past six 
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months. This decrease is evidence of the declining case load 
in the Centers still operating. The largest case load was 
in the five private professional-technical schools (median, 143 
per month total period of operation)-, followed by the iS 
private universities (median, 115 per month — total period of 
operation). The smallest case load was in the 15 public liberal 
arts colleges with a median of 34 per month for the total 
period of operation. The 47 private institutions as a group 


TABLE 1 

Gt&gniphit Diftnbuiwn rf Cdtcxf* and Urnttrstfifs Contacted and Responding 


Kmi.J'rt I’rr (’«nl 


Rcspondirg 
V umber Per Ccm 


New England 

5 

2 

3 

60 

Central Nnrthrait 

+J 

l8 

34 

76 

South 

S 1 

21 

33 

6 $ 

Midwest 

s» 

21 

41 

79 

Central Northwest 

u 

lO 

16 

67 

Southwest 

39 

tl 

is 

Sa 

West Coast 

.16 

*5 

aa 

61 

Outside U. S. A. 

I 

1 

0 

0 

Total 

29.1 

TOO 

164 



ArVw England- New Hampshire, Maine. Vermont, M.vwachu.icttt, Rhode Island, 
Connecticut 

Central Setrtheatt New York, Pennsylvania, Maryland, New Jersey, West Virginia, 
iDfluwii ffr 

District of Columbia, Virginia, Kentucky, North Carolina, South Cnrolimi, 
Tennessee, Arkansas, I-ouifinisn, Mrsissippi, Alabama, Ocotyyia, Florida 
Mnlu.ru Ohio, Indiana, Illinois, Michigan, Wisconsin, Missouri, Iowa, Minnesota 
Central E'nrtAnrit North Dakota, South Dakota, Nebraska, Kansas, Colorado, 
Wyoming, Montana, Idaho, Utah, Nevada 
Saulhaett Ancona, New Mexico, Oklahoma, Texas 
For H’rU nr If’ett CaaU ■■ Washington, Oregon, California 

Outtidt V. $. ,y.- -Puerto Rico _ , 

Of the returns utilised, three were from New England, m were from the Central 
Northeast, n were from the South, -n were from the Midwest, 16 were from the 
Central Northwest, 15 from the Southwest, and 31 from the West Coast. 1 He per cent 
of returns by sections ranged from 51 to 70, with the Midwest highest and the South- 
west lowest. 


had a case load of ri4 per month for the total period of opera- 
tion as compared with median of 64 for the 103 public institu- 
tions supplying data on this question. However, the private 
institutions had shrunk to a case load of only 80 during the 
past six months, a decline of 30 per cent, while the public 
institutions had decreased from a median case load of 64 to 
48 or 24 per cent. Apparently business is declining slightly 
more rapidly in the private institutions with their relatively 
larger case loads. 
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Let us turn our attention to the question of how many 
Centers made their services available to student non-veterans 
as well as to veterans. The institutions were not compensated, 
of course, by the V. A. for non-veteran students Sixty-six 
per cent, or two-thirds, checked" Yes” to the question of whether 
they served non-veteran students. It was rather surprising to 
find that this policy was more prevalent among private in- 
stitutions than public colleges and universities. Thirty-nine 
per cent of the public institutions did not serve non-veteran 
students as compared with 22 per cent for private institutions. 
In the 19 smaller private universities with less than 10,000 
students only three catered only to veterans; in the eight 
larger universities the ratio was 50-50. Of the 15 public junior 
colleges, only two restricted their services to veterans. In later 
published accounts of this study we hope to present the per 
cents for all types of institutions, public and private. For 
obvious reasons it is not feasible to attempt to present them 
orally now. 

Of the 66 per cent of the institutions which provided testing 
and counseling services to non-veteran students, slightly more 
than two-thirds did so without charge. In the public institutions 
whose V. A. Guidance Centers accepted non-veteran student 
clients, eight out of 10 did so without charge as compared 
with five out of 10 in the private institutions. 

Of the 32 institutions which reported the amount of the fee 
charged non-veteran students, the median was $20 with a 
Q 1 of $8 and a Q 3 of $20. The effect of the V A. rate of $20 is 
apparent. In the 13 public institutions reporting data on fees 
to non-veteran students, the median fee was only $8. 

Another item of popular interest is the extent to which the 
testing and counseling services of the Center have been avail- 
able to non-veteran clients from the community. The V. A., 
of course, did not pay for this service. In general, the practice 
was approximately 50-50, with 55 per cent answering “Yes” 
and 45 per cent "No.” In the 49 private institutions, however, 
two out of three accepted community non-veteran clients. The 
median fee for community non-veteran clients for all colleges 
and universities was $20, the same as the non-veteran student. 
In the public institutions the median fee was $20, the same as 
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in private colleges and universities. The Q* of private institu- 
tions, however, was $15 as compared with a Q 5 of $20 in public 
institutions. Apparently the price ceiling was a bit higher in 
private institutions. 

What proportion of the case load consisted of clients from 
the community and non-veteran students from the institution? 
In an effort to answer this question the following item was 
inserted in the questionnaire: 

Within the past ms mouths, what proportion of new cases pro- 
cessed by the Center have been 

A. Veterans from your own institution? _____ 

B. Non-veterans from your own institution? 

C. Veteran clients from the nearby community? 

I). Nun-veteran clients from the nearby com inunity? 

Twenty-arte of the 154. institutions were unable to answer 
this question because they kept no records by such a break- 
down. The 1 jj reporting stated that 52 per cent of their clients 
were veteran clients from the nearby community, 33 per cent 
veterans from their own institution, ri per cent non-veterans 
from their own institution, and 3 per cent non-veteran clients 
from the nearby community. This information reveals that 
only 15 per cent of the clients were non-veterans. The distri- 
bution of clients among these four categories was essentially 
the same for both private and public institutions. The per 
cent of non-veteran clients front the nearby community was 
slightly higher in the private institutions, 5 per cent as com- 
pared with 2 per cent in public colleges and universities. 

The proportion of non-veterans from their own institutions 
was relatively small, only 11 per cent. The distribution of 
various types of clients in the various types of institutions was 
remarkably consistent. It is rather surprising that the case 
load consisted of so few non-veterans from the institution in 
view of the fact that more than half of the Colleges and Univer- 
sities answered “Yes’’ to the followingquestion: "Has the Y. A. 
Guidance Center been regarded as an integral phase of the 
institutional program so that student veterans as well as non- 
veterans have been systematically and continuously referred 
to it from other departments of the institution?” 

The final question on Part I of the questionnaire was: “Prior 
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to the inauguration of the V. A. Center, was there existent 
on campus a centrally organized service with a director in 
charge responsible for testing and counseling students in re- 
gard to their vocational plans?” Slightly more than half of the 
institutions answered “No” to this question. Among the private 
institutions, two out of three had not had previously a centrally 
organized service. In view of the importance of this particular 
question and its interest to people in various types of institu- 
tions, I shall run the risk of confusing you and give the per 
cents of all types of institutions which stated that they had not 
had previously a centrally organized service with a director 
in charge responsible for testing and counseling students in 
regard to their vocational plans: 

m , _ Private Public 

Type of Institution Number Per Cent Number Per Cen t 


Small University 

15 

79 

IS 

56 

Large University 

3 

32 

7 

35 

Liberal Arts College 

n 

73 

8 

53 

Professional or Technical 

4 

67 

6 

54 

Junior College 



9 

4° 

Teachers College 

— 

— 

9 

53 

Total 

53 

67 

54 

5i 


And now we come to the “sixty-four dollar question” : “When 
the V. A. contract is no longer in effect, what do you plan to 
do with the Guidance Center?” Only four of the 154 institu- 
tions reporting stated that they were planning to discontinue 
the Center and abandon the testing and vocational counseling 
service. Six of the 154 Colleges and Universities reporting in- 
dicated that they were planning to discontinue the Center 
and continue to offer testing and vocational counseling under 
a decentralized program. Fifty-seven per cent went on record 
to the effect that they intended to continue the Center essen- 
tially as at present Twenty-five per cent reported that they 
were planning to discontinue the Y. A. Guidance Center as 
now organized but would continue to offer the testing and coun- 
seling service in a newly organized (or reorganized) manner 
as a part of a systematic guidance program Apparently there 
was some confusion in replying to the query as to whether 
or not they planned to discontinue the Center. From the quali- 
fying remarks it was apparent that most of the institutions 
which stated they planned to discontinue the Center but con- 
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tinue to offer testing and counseling service, interpreted “dis 
continuing the Center” to mean discontinuing the V.A. rela- 
tionship, discontinuing the present administrative set-up for 
the Center, or making other changes in the organization of the 
Center. 

Thirty -six institutions, or 23 per cent of the total of 154 
replying, stated that it is impossible to say at the present 
time what will be done with the Center. Twelve of these 
also checked tlvat they were planning to continue; five that 
they would discontinue. Many of these qualified their answers 
to indicate that they would make every effort to continue 
it in some form or other. An analysis of these qualifications 
will tie presented a little later. 

One hundred and twenty-six or ha per cent of the 154 in- 
stitutions reporting stated that they planned either to continue 
the Center essentially as at present or to continue to offer 
the testing and counseling service in an organized manner as 
a part of a systematic program. Of these 126 institutions, 87 
or 57 per cent stated unequivocally that they were planning 
to continue the Center essentially as at present. Sixty-five 
per cent of the private colleges and universities took this 
position as compared with 52 per cent of the public institutions. 
Let us examine the more detailed future plans in these 87 
institutions. Four our of five stated that they would make 
their services available to all interested students and of this 
number two-thirds indicated that the service would be without 
charge. Some institutions indicated that the service would be 
without charge to students referred by a student personnel 
officer and on a fee basis to others. Approximately one out of 
four replied that the service would be on a fee basis after the 
V. A. contract had expired. Eighteen per cent, mostly private 
institutions, thought they could best handle the situation by 
increasing the activity fee for all students. Four institutions 
hoped to finance the program by philanthropic support. Only 
one institution out of six plans to limit the service to students 
having special needs. 

Seven out of 10 institutions planning to continue the Center 
essentially as at present, plan to make its services available 
to interested clients from the community, largely on a fee 
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basis, Only n per cent of those planning to serve the com- 
munity plan to do so without charge and all of these colleges 
and universities are publicly supported institutions. 

I stated previously that 36 institutions, or 23 per cent of 
the 154 returning usable questionnaires, stated that it was 
impossible for them to say definitely at the present time what 
will be done with the Center. Let us consider some of the 
reasons which they gave for their indecision. Nine out of 10 
stated that a decision was dependent upon the availability 
of funds. All but one of the 18 publicly supported institutions 
who were undecided stated that it was a matter of budget. 
Apparently the availability of qualified personnel is not too 
serious a problem, for only one-fourth of the institutions still 
undecided checked that availability of qualified personnel would 
influence their decision. Four out of 10 went on record as saying 
that their decision would depend upon further evidence as to 
the need for the service Only one-sixth of the institutions 
still undecided were of the opinion that further evidence was 
needed as to the value of the service before they made their 
decision. 

What were the considerations which lead the college or uni- 
versity administration to continue the Guidance Center after 
the V. A. contract is no longer in effect? A series of four state- 
ments was presented in the questionnaire to be checked if 
appropriate. Plenty of space was left for stating other con- 
siderations which affected the decision but there were very few 
reasons added. One hundred and eighteen colleges and uni- 
versities checked the considerations which influenced them in 
deciding to continue the Center These included the 87 insti- 
tutions that had made a definite statement to continue the 
Center essentially as at present, as well as 31 additional 
institutions which planned to offer the testing and counseling 
service in a newly organized or reorganized manner, or stated 
on the questionnaire that they were undecided at the present 
time concerning the future of the Center but hoped to continue 
it. Slightly more than one-third of the 118 institutions replying 
to this section of the questionnaire stated that “Testing and 
vocational counseling through a Guidance Center were in oper- 
ation here before the V. A. contract went into effect and we 
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shall be returning essentially to our former program.” Thirty- 
eight per cent of the public institutions and 30 per cent of the 
private institutions made this statement. Only three of the 
lb private universities with an enrollment under 10,000 stated 
that in continuing the Center they would be returning essen- 
tially to a pre-V. A. program. Knur of the five private profes- 
sional-technical colleges nr universities and 10 of the 17 large 
public universities indicated that by continuing the Center 
they would be returning essentially to a pre-war guidance 
program . 

Two-thirds of the institutions went on record as saying that 
“The V. A. Guidance Center has demonstrated the value of 
testing and vocational Counseling as an organized service which 
we wish to incorporate into our program of student personnel 
services.” In an examination of these data, it was observed 
that many institutions which did not check this reason were 
colleges and universities which had had a Guidance Center 
before the. V. A. program was inaugurated and felt that they 
were returning essentially to it. Sixty-eight per cent of the pri- 
vate institutions, as compared with 59 per Cent of the public 
institutions, voiced the opinion that the V. A. Guidance Center 
had demonstrated a service which they wished to incorporate 
in their program of student personnel services. This opinion 
was most prevalent in the small private universities and the 
public professional-technical schools. The only marked de- 
viation from the trend of replies to this question was in the 
large public universities with a per cent of 30, This is 
undoubtedly attributable to the fact that 59 per cent of these 
large public universities felt that in continuing the Center 
they were returning to a previously accepted student personnel 
service. 

The following possible reason for continuing the Center was 
included among the list of considerations which might 
he checked. "Students, both veteran and non-veteran, have 
come to accept testing and vocational counseling as a legitimate 
institutional service and expect the institution to continue 
to provide this assistance.” Fifty-eight per cent of the institu- 
tions checked this reason. The replies were very consistent 
among the various types of private and publicly supported 
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colleges and universities The only marked deviation was found 
among the twelve public junior colleges of whom only 2.5 
per cent checked this reason for continuing the Center. 

Approximately half of the colleges and universities planning 
to continue their Guidance Centers, specified as one of their 
reasons that "The need for testing and counseling services 
available to non-student clients has been expressed by repre- 
sentative agencies and members of the community.” Fifty- 
seven per cent of the private institutions checked this as a 
reason as compared with 43 per cent of the public institutions. 
Eighty per cent of the large private universities and 70 per 
cent of the private liberal arts colleges gave this as a reason 
for continuing the Center. It is rather surprising that the 
private institutions were more sensitive to the expressed de- 
sire of representative agencies and members of the community 
than were the public institutions. Only 33 per cent of the small 
public universities gave public pressure as a reason for con- 
tinuing 

Another section of Part II of the questionnaire dealt with 
the considerations that entered into a decision to discontinue 
the Guidance Center. Only 25 institutions elected to answer 
this section. These consisted of 4 who were planning to 
abandon the service, 6 who were planning to decentralize 
the guidance program, and 15 who were still undecided but 
leaning toward discontinuing the Center Of this number one- 
third gave as their reason, “It is primarily a program 
for veterans and the need either has been or will have been 
met ” Only one of the 25 colleges and universities stated that it 
was planning to discontinue the Guidance Center for the reason 
that “The value of the service for students generally has not 
been adequately demonstrated.” This one institution was a 
small private university whose identity must be carefully con- 
cealed from this audience. Seven out of 10 of the institutions 
reporting checked the reason for discontinuing as “The cost 
of maintaining the service without V. A. or other outside 
support is prohibitive.” Two institutions inserted the statement 
on the questionnaire that lack of space and facilities was the 
reason for planning to give up the Guidance Center 

In an attempt to tap general attitudes concerning the in- 
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fluence of the V. A. Guidance Center on the student personnel 
program of the institution, a series of statements was presented 
with the request that the pertinent statements be checked. 
The college anti university administrators were requested to 
give their reactions to these statements regardless of what they 
planned to do in the future with their Guidance Center, These 
statements will Iw considered one by one. One hundred forty- 
nine of the 154 colleges and universities gave their reactions 
to these statements- 

1 , Counsel of doubtful value has actually caused a considerable 
numlvcr «>f students and faculty to question seriously the 
worthwhslenc®** of testing and vocational counseling. 

Only one institution, a public liberal arts college, checked 
this statement as true. And if you are from a public liberal 
arts college, I am sure it is not your institution. 

j. The influence has been negligible. 

Only five institutions out of 149 or 3 per cent stated that the 
influence had been negligible. Four of these 5 institutions 
were publicly supported colleges or universities, a of these 
were junior colleges. 

j, The service has not been sufficiently integrated into the 
Hifrtkut'ionnl program that it has been, adequately known 
ami utilized by either faculty or students. 

Thirty institutions, orao percent, voted that this statement 
was true. On this item the proportion of private institutions 
voting “ Yes” was twice as great as among public institutions 

4. The service is probably worthwhile but cannot be main- 
tained without outside support such as was received under 
the V, A, contract. 

One out of five indicated that this was true, with the pro- 
portion from the private institutions twice as great as from 
the public institutions. 

$. The service lias been worthwhile for veterans but will not 
be needed when student veterans are no longer present in 
considerable numbers. 

Six per cent felt that the service would no longer be needed 
when student veterans were no longer present in considerable 
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number Apparently the value of a testing and vocational 
counseling service for college and university students is now 
overwhelmingly accepted. Seven of the nine institutions were 
publicly supported colleges and universities, with a vote of one 
or two from each type of public institution. 

6. The services provided by the Guidance Center must be con- 
tinued although the Center itself may not continue to func- 
tion as an operating unit. 

Forty-four per cent of the institutions indicated that this 
was true. An inspection of the data reveals that many insti- 
tutions which did not check this statement as true had already 
indicated that they were planning to continue the Center per 
se and were therefore not much concerned about the problem 
of preserving the testing and counseling functions without 
a Center organization. 

7. The need for testing and vocational counseling has been 
demonstrated so clearly that with minor modifications the 
Center must be continued. 

Fifty per cent of the institutions checked this statement as 
true. It is rather surprising that this per cent is not larger 
in view of the fact that 80 per cent of the institutions reporting 
had stated previously that they planned either to continue 
the Center essentially as at present or to continue to offer 
the testing and counseling service in an organized program 
of vocational guidance. Possibly many of these institutions 
who felt that they would have conducted an organized guidance 
service with or without the V A. Guidance Center demonstra- 
tion, thought it unnecessary to check this particular reason. 

8. The Guidance Center has influenced our student personnel 
program in the following ways : — followed by eight possible 
statements to be checked. 

Eighty-seven per cent of the institutions returning usable 
questionnaires chose to answer this section; 13 P er cen ^ did 
not commit themselves to any of the following statements. 

a. It has demonstrated the need and the demand for testing 
and vocational counseling services. 

Six out of 10 of the 134 institutions which answered this 
section checked that the Guidance Center had demonstrated 
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the need and the demand for testing and vocational counseling 
services. 

b. It has shown the practical value of testing and vocational 
counseling services in helping students make better adjust- 
ments in college. 

Approximately three- fourths of the institutions replying 
checked this statement as true. 

c. It has stimulated discussion and study of the whole problem 
of providing testing and counseling service for more stu- 
dents on a systematic and coordinated basis. 

Again, approximately three-fourths of the colleges and 
universities responding stated that this statement was true. 

d. It has developed new techniques and procedures in testing 
anti counseling. 

Only one-third of the colleges and universities responding 
checked this statement as true. Apparently the institutions 
felt that the program had been largely implemented by existing 
techniques and procedures rather than through the devel- 
opment of new methods and tools. 

e. It has provided additional equipment and materials which 
will be of value after the V. A. contract is no longer in effect. 

Slightly more than two-thirds of the institutions responding 
checked this statement as true. Presumably these materials 
and equipment provide a back-log of counseling facilities and 
resources which the institutions are planning to put to good 
use in more than two-thirds of the colleges and universities. 

f. It has developed trained personnel who will continue to be 
of service to the institution. 

Approximately two-thirds of the institutions checked this 
statement as true. 

g. It has resulted in an expanded budget for testing arid coun- 
seling which will make it easier to maintain such services 
in the regular institutional budget even after V. A. funds 
are no longer available. 

Forty per cent of the institutions checked this statement 
as true, Among the public institutions the per cent checking 
this statement true was twice as great as among private colleges 
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and. universities. In all, 54 institutions felt that their present 
expanded budget for testing and counseling would make it 
easier to maintain budgetary provisions for this program after 
V. A. funds are no longer available 

h. It has provided a laboratory useful in the training of psy- 
chometrists, counselors, and other student personnel 
workers. 

Three out of 5 of the number responding checked this 
item as true. In the large private universities 84 per cent 
marked this item as true, and in the large and small public 
universities 78 per cent indicated that this statement was 
true. Naturally, in the smaller institutions the training function 
of the program received a smaller vote. 

Under remarks pertaining to the above eight questions many 
institutions volunteered the comment that they had been sold 
on the value of testing and vocational counseling for college 
and university students but that they planned to make many 
short-cuts and modifications of procedure when they no longer 
had to follow the prescribed V. A. pattern. I am sure that the 
Vocational and Rehabilitation Division of the Veterans Ad- 
ministration would be quick to grant that certain records and 
forms could well be modified, or dispensed with, in a college 
set-up, in which the problem of transferring records from one 
region to another does not exist. On the other hand, the use 
of these standard forms is likely to result in more uniformity 
in forms in college guidance centers long after the V. A. College 
Guidance Program is history. 

What may we conclude from this survey of the present 
administrative policies and future plans of College and Univer- 
sity Guidance Centers operating under V A. contracts? The 
following conclusions seem warranted 1 

I. In establishing the V A College and University Guidance 
Centers, the V. A. was motivated primarily by the desire 
to provide high-quality testing and vocational counseling lor 
veterans in strategically selected locations, but was alsomindfu 
of the possible desirable influence of this program on student 
personnel work generally and on collegiate sponsored adult 
guidance centers. 
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2. Two-thirds of the Centers have been making their services 
available to student non-veterans as well as veterans. More 
than two-thirds of these colleges and universities provided this 
vocational guidance service to non-veteran students without 
charge. In the publicly supported V. A. College Guidance 
Centers, approximately four-fifths of the Guidance Centers 
served non-veteran students without charge. Where a charge 
was matte, the median fee for ail types of colleges and universi- 
ties was $20 although in the public institutions the median fee 
was only $8. 

3. Half of the Centers have been offering testing and counsel- 
ing services to non-veteran clients from the community. This 
practice is much more prevalent in the private institutions. 
The median fee is the same as for non-veteran students, $20, 
although in the private institutions a Q* of $25 reveals that 
one-fourth of the clients pay above that amount. 

4. More than half of the case load of the Centers consists 
of veteran clients from the nearby community, one-third vet- 
erans from the collegiate institution housing the Center, one- 
tenth non-veteran students from the local college, and only 
3 out of a 100 are non-veteran clients from the nearby commu- 
nity. The proportion of non-veteran students served is puz- 
zlingly low in view of the fact that almost two-thirds of the 
colleges and universities stated that student non-veterans, along 
with student veterans, have been systematically and contin- 
uously referred to the Center. 

5. Prior to the inauguration of the V. A. College Guidance 
Center, more than half of the institutions did not have a cen- 
trally organized testing and vocational counseling service with 
a director in charge. This was particularly true in the private 
institutions. 

6. Only 10 of the 15+ colleges and universities reporting 
stated definitely that they plan to have no Guidance Center 
when the V. A. contract has expired, and of this number six 
Indicated that they were planning to offer testing and voca- 
tional counseling under a decentralized program, 

7. Four out of five institutions reported that they planned 
either to continue the Center essentially as at present or to 
continue to offer the testing and counseling service in a cen- 
trally organized program. 
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8. Eighty per cent of the institutions, planning to continue 
the Vocational Guidance Center, are planning to make its 
services available to all interested students, and 3 out of 
5 are planning to provide this service without charge. The 
other Centers planning to continue will operate on a fee basis 
or by an increase in the student activity fee A few institutions 
are looking for philanthropic support to continue the service 

9. Approximately one-fourth of the colleges and universities 
stated that it is impossible to say definitely at the present time 
what will be done with the Center although many of them 
stated that they will continue if it is financially possible. Nine 
out of 10 of the colleges and universities still undecided stated 
that it was a matter of funds. 

10. Seven out of 10 institutions planning to continue the 
Center will make its services available to clients from the 
community, largely on a fee basis. 

11. The reasons most frequently advanced by 115 colleges 
and universities for deciding to continue the Center were: 

a. The V. A. Guidance Center has demonstrated the value of 
testing and vocational counseling as an organized service 
which we wish to incorporate into our program of student 
personnel services ; 

b. Students, both veteran and non-veteran, have come to 
accept testing and vocational counseling as a legitimate 
institutional service and expect the institution to continue 
to provide this assistance; 

c. The need for testing and counseling services available to 
non-student clients has been expressed by representative 
agencies and members of the community. 

12,. Only one institution of the 23 colleges and universities 
which advanced reasons for discontinuing the Center stated 
that “The value of the service for students generally has not 

been adequately demonstrated ” 

13. A series of checked statements on the possible influence 
of the V. A. Guidance Center on the student personnel program 
revealed that a continuing need for the service was recognized, 
that the testing and counseling program to date had been 
highly satisfactory, and that it must become an integrated 
part of a comprehensive student personnel program I he in- 
stitutions responding were generally of the opinion that ew 
new guidance techniques or procedures had been developed, 
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and expressed an intention to simplify forms and procedures 
when no longer under V. A. contract. The training of qualified 
personnel, the availability of basic equipment and materials, 
and a currently expanded budget which will make it easier 
to maintain vocational guidance services in the future, were 
advanced as major tangible gains resulting from the V. A. 
College Guidance Program. 

It is apparent that testing and vocational counseling on the 
college and university level has received real impetus from the 
V. A. Guidance Program and that with minor modifications 
the programs will continue when the V. A. contracts expire. 
Counseling services for adults in the community have also 
been greatly expanded under the V. A. campus guidance pro- 
gram and 70 per cent of the colleges and universities planning 
to continue their Centers essentially as at present will offer 
this community service. 

I am sure that it is unnecessary to suggest to you that you 
carry this story hack to the President of your college or uni- 
versity and let him know that if he is planning to go ahead 
full steam with a testing and vocational counseling service, he 
is in the good company of the leading institutions of the 
country. Remember, only one college or university out of 154 
stated that it was planning to discontinue the program because 
the value of the service had not been adequately demonstrated. 
With such a clear case, ways and means must be found to 
provide an adequate program of testing and vocational counsel- 
ing for all college and university students. Under the 
stimulation of the V. A. College and University Guidance 
Centers, amaxing progress has been made in the past four years 
and the future looks good. 



STUDENT ACTIVITIES: AN INTEGRAL PART 
OF A COLLEGE PERSONNEL PROGRAM 


A BLAIR KNAPP 
Dean of Students, Temple University 

This paper is not designed to be a systematic analysis of 
student activities and their place in the educational process 
Like most workers in the field of personnel, I have many more 
questions than answers. Like all of you, I have developed some 
convictions about the educational process, the personnel pro- 
gram, and the place of student activities in both. This paper 
will outline some of these convictions in the hope that they may 
be suggestive and be a basis for discussion. 

In many respects student personnel work “has come of age." 
All who have been working in the field for fifteen years or more 
are keenly aware of the progress that has been achieved. A 
professional philosophy has grown out of the “work-a-day” 
experience of hundreds of personnel workers. Since 1937 it has 
been formulated as “the personnel point of view.” Today it 
is accepted almost universally by personnel workers. In fact, 
educators, who are not formally or consciously personnel work- 
ers, are now accepting its principles as the basic philosophy of 
education as a whole. Our several organized associations of 
personnel workers have gained status and prestige in the ed- 
ucational world. Their annual programs are increasingly vital, 
stimulating, and professional. Publication in the field, both in 
general and on specialized subjects, increases in volume and 
more significantly in professional quality. We have learned to 
lean heavily on modern psychology and are progressively de- 
veloping cooperative relations with the workers in this field. 
This has already paid rich dividends in improved counseling 
techniques, constantly revised testing procedures, substantial 
improvement in methods and procedures for corrective, re- 
medial, and therapeutic work with individuals, and in many 
other ways with which we are all familiar Personnel workers 
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are not only accepted as essential on nearly all campuses, but 
their status and influence continue to grow. Many more items 
might be added to demonstrate our substantial progress. It 
is my conviction, however, that nearly all of this progress and 
growth both in understanding and in practice relate primarily 
to the diagnosis, counseling, and therapy of the individual 
student. They have not been matched by similar progress in our 
understanding of, and work with, student groups or so-called 
student activities. 

There may he exceptions, but in general our student activity 
programs, like Topsy, “just growed.” Activities are largely 
unplanned and uncoordinated with each other. They are not 
integrated with the educational process of the university as a 
whole. Their educational orientation and purpose has too fre- 
quently been lost entirely. Generally we cling to traditional 
patterns of organization and procedure despite the fact that 
the whole process of education has been radically altered. 

A year ago the President of this association delivered a 
challenging address in which he discussed some of our profes- 
sional short-comings. His list was an excellent one. From my 
own point of view, our failure to thoroughly understand the 
student life on our campuses, and to guide it effectively toward 
educational objectives, is our most serious short-coming. 

This paper is being written for presentation to fellow person- 
nel workers. Presumably, therefore, I can assume that we 
would he in agreement on the following propositions: 

1. A well-planned program of student activities is an essen- 
tial element in the educational process. 

2. This activities program must be integrated with the life 
of the entire university and college and must be specifi- 
cally directed toward educational objectives. 

3. The responsibility for leadership in planning such a pro- 
gram rests squarely on the shoulders of the student per- 
sonel organization on most campuses. 

At least since the formulation of the general statement of the 
personnel point of view in 1937, we who work in this field have 
been pretty well agreed that education is a process of growth; 
that this growth must be of the whole individual as a unique 
personality; and that the ultimate aim of the educational proc- 
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ess is the development of the maximum effectiveness of the 
individual within himself and with his fellows. We may differ 
in methods and techniques, in schemes of organization, and in 
our no tion of emphasis ; but we are one in philosophy and perspec- 
tive- Recent events in education and in the world in general have 
tended to emphasize more and more the responsibility which 
educators have, to develop social effectiveness in their students. 
We now know that our civilization has a technical competence 
greater than any ever possessed by man and accompanies it with 
an incompetence in human relations which carries the seeds of 
disaster for all of us. There is a new sense of urgency, which we 
all feel in varying degrees, that we need to revolutionize some of 
our educational practices. We are beginning to Understand that 
the whole educational process must be re-examined and re-eval- 
uated in the light of the new imperatives of our time. Revolu- 
tionary changes in curricular content, teaching methods, and 
some of our own personnel practices will result from such an 
analysis This will be especially true of the whole complicated 
pattern of student life which is known as the activities program. 
It will have to be continuously planned and developed as new 
demands are made upon it. 

I think we must assume that the personnel organizations 
will be expected to provide the leadership in this process. Our 
campuses differ widely in the extent to which the personnel 
organization as such is administratively responsible for the 
activities program. Despite these differences, I am convinced 
that personnel workers will have to take the initiative. We had 
to pioneer in the development of the personnel philosophy and 
its implementation in terms of the emphasis on the individual 
and his needs. I do not see how we can escape the role of pioneer 
again in the implementation of the personnel point of view in 
terms of student life and its orientation to educational objec- 

tives. . . , 

Assuming, then, that you and I are agreed that a new kind 
of planning is required, let me suggest certain ideas that seem 
to me to be fundamental to the process. In the first place, we 
need to have some notion of the frame of reference within which 
our planning will take place Some of the elements are suggested 
below. Each of you will be able to add to the list. 
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The university and the college is a different place in i 949 
than it was in 1900. In all probability it will change more 
rapidly in the next ten years than in the last Forty-nine. Any 
consideration oF student activities must, thereFore, be in ref- 
erence not only to the circumstances and requirements oF today, 
but also oF the next Few tomorrows insofar as we can foresee 
them. That is why I emphasize the phrase “continuous plan- 
ning." A program carefully developed For the needs of 1950 
will probably be inadequate before 1955. An essential element 
in our Frame of reference, then, must bca keen sense of the accel- 
erating rate of change on the campus as well as in the world 
generally. 

One obvious change in the past fifty years is in the matter 
of numbers. There were roughly 200,000 college students in 
1900; fico.ooo in 1920; 1,500,000 in 1940; and 2,400,000 in 
1948. You may take your choice with regard to predictions for 
future enrollments, hut most of us would agree, I think, that, 
barring war, the college population will never again approach 
a pre-war normal. Disregarding annual fluctuations, relatively 
unimportant, there are social forces at work which require us 
to assume continued increases in student population. Our ac- 
tivity programs have probably never met the needs of all of 
our students. If we arc to plan adequately wc shall be forced 
to think in terms of numbers substantially greater than we 
have heretofore served successfully. 

A parallel and related development to the increase in num- 
bers has been the change in the motivation of students attend- 
ing college. It seems pretty clear that for most students the 
vocational objective is primary. Students in Liberal Arts Col- 
leges are no exceptions. They are pre-this or pre-that or are 
preparing to be professional biologists, psychologists, etc. De- 
spite the fact that educators think, or at least speak, increasingly 
of the social objectives of the educational process, our students 
are thinking more than ever before of the educational expe- 
rience in terms of preparation to make a living. If the interest 
of a majority of students is to be aroused, the activities pro- 
gram must be planned so that it ties in with this vocational 
motivation at some point. Otherwise, a new and more effective 
orientation to the educational process and its objectives must be 
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developed so that the motivation of students is broadened to 
include the social on the same level of intensity as the voca- 
tional. We cannot ignore student motivation whether we are 
planning a curriculum or a student activities program. We must 
either build on existing motivation or broaden its base. 

A third element in our frame of reference basic to any plan- 
ning of an activity program is a sensitivity to the new and grow- 
ing heterogeneity of our student bodies. This extends to social, 
religious, nationalistic, and economic groups. Developing plans 
for foreign student exchange, for the admission of student 
displaced persons, for wider and deeper college enrollments from 
the secondary schools mean increased heterogeneity and a new 
heterodoxy of ideas in every direction. An activities program 
which fails to take this into account will fail to meet the needs 
of large numbers of students. 

A fourth development which must be kept in mind is that 
modern life is becoming increasingly institutionalized and im- 
personal. The conflicts of today are not personal conflicts, but 
competitions between highly organized groups. The individual 
finds himself increasingly helpless alone and seeks psychological 
as well as physiological security in joint action with others. 
This produces a more “structured” type of living and a greater 
dependence upon a leader or leaders who in turn become symbols 
of unity and conflict Personalities are becoming segmented 
in the process so that, increasingly, conflicts arise between 
different aspects of one’s own personality and interests. On 
our larger campuses this process of institutionalization is in- 
creasingly apparent. It must be taken into account in our plan- 
ning. This problem warrants a full discussion on its own. Suf- 
fice it to say here that we must be careful that our student life 
does not become so institutionalized that we lose the “whole 
personality” which we have stressed in our personnel work. 
On the other hand, if there is too little of it on our campuses, 
we may be denying our students a chance to learn to live with 
and in the new patterns while in college, and thus send them out 
inadequately prepared to cope with community life. 

Lastly, it strikes me as important to keep in mind that the 
conflict between “town and gown” is either disappearing or 
taking on entirely new aspects. Our students do not feel aloof 
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from the larger community. The university or college is part of 
the community and is considered to he so by its own constit- 
uencies as well as by citizens generally. This should have im- 
portant implications for an activities program. For one thing, 
it certainly means that the university need not develop its en- 
tire activities program within the confines of the institution. 
The activities of the whole community are available as never 
before as educational experiences of significance. The skill with 
which such community activities arc interwoven with those of 
the university will have much to do with the success of the 
program as a whole. 

These items are suggested as some elements in the frame of 
reference which should he noted before planning is undertaken, 
and should he kept in mind constantly as planning proceeds. 
Two things will now he suggested as preliminary steps to he 
taken before an activities program can be shaped successfully 
on any planning board. They can he done at the same time, 
but are distinct tasks. The first is a comprehensive self-survey 
of student life and of the whole educational process on each 
campus. The second is the analysis of educational goals to be 
served by the activities program in terms of specifics instead of 
generalities. Each is a major undertaking. 

We can do no more than outline in this paper the scope of 
such a self-survey. The notion of such a survey assumes that 
the university or the college is a community. Its purpose is to 
inventory, analyze, and evaluate community resources and 
needs. It must be both quantitative and qualitative. It will 
require the combined efforts of large numbers of students and 
faculty as well as skillful leadership and direction. It should 
certainly involve the social scientists on the faculty, especially 
the social psychologists and the sociologists. We have derived 
much benefit from our cooperation with workers in the field of 
personal and clinical psychology. Personnel workers and social 
scientists have been equally remiss in not developing similar 
cooperation with respect to the group life of our students. We 
regard training in psychology as a standard base on which to 
create a career in personnel. In my judgment, our personnel 
programs will be in better balance when we regard training in 
the social sciences as equally significant and only when our 
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personnel staffs are liberally sprinkled with persons so trained. 
We are so impressed with the lag of the social sciences as com- 
pared with the so-called natural sciences that we tend to over- 
look the substantial progress of the last twenty-five years. 
Greatly influenced by modern psychological research, social 
scientists are developing techniques and skills which are pro- 
ducing results. If we can focus these skills and techniques on 
the complicated phenomena known as student life, we shall be 
rewarded through a new understanding and a new certainty 
in method and administration. A survey such as is proposed 
here would be an excellent opportunity to begin to get this 
help and cooperation. 

Among the many specific items which such a survey should 
include, the following might be cited as typical and suggestive 
of others' 

1. A scientific study of the student population to give a more 
precise understanding of the growing heterogeneous char- 
acter of our student bodies should be one item. In one 
large urban university an isolated study, very limited in 
scope, disclosed that 28 per cent of the entire student 
body came from homes in which both parents were foreign 
born, while 18 per cent more had one parent born abroad. 
Just short of 50 per cent of this student population came 
from homes in which the patterns of American living and 
thinking might be expected to deviate significantly. What 
an impact this one “vital” statistic should have on the 
planning in that institution! What else might we learn 
about our students that would be equally significant Too 
many of us grew up and were trained when and where 
student bodies were essentially homogeneous. Our new 
situation is developing so rapidly that we are only vaguely 
aware of it, and its implications. 

1 , A systematic analysis of the existing student organizations 
and activities would be another product of this survey. 
Such an analysis would include many sub-items. When 
was the activity organized? Forwhatpurpose?Haveits pur- 
poses changed? If so, have these been reflected in the organ- 
ization? If not, are the purposes still valid educationally? 
How are members selected? Is the criterion of selection 
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personal choice, social, religious, or political interest, schol- 
arship, etc-? How are officers selected? How many mem- 
bers attend meetings regularly? What is the relationship 
between adviser and group? What are the duplications 
in membership between groups? Each of us can add the 
other items which are essential to a complete analyis of 
an activity or an organization. Such a study would be 
climaxed by an evaluation of each activity in terms of the 
educational objective. What has the activity contributed to 
the membership in terms of specific items of growth? How 
effective have the members been in contributing to the 
group objectives? Specific criteria of evaluation should 
be developed so that the analysis might have tangible 
value. General criteria such as "Does the activity pro- 
mote the art of living together and does it develop sound 
ethical and cultural standards in social relationships?" 
arc valid ami useful notions, but criteria of this type do 
not lend themselves to reliable reporting in an evaluation 
study. 

3. The survey should disclose the number and kinds of stu- 
dents who do not participate at all in organized student 
life. It should provide for a careful analysis of reasons for 
their non-participation with special emphasis on the prob- 
lem of motivation and the quality of their understanding 
of the nature and objectives of the educational process. 

4. A systematic analysis of the felt-needs of students should 
emerge from the survey. This should be correlated with 
the needs that are identified by advisers and faculty gen- 
erally. Too many times we fail to utilize the wealth of ideas 
which would be available to us if we would assist our 
students to be more articulate about their own thinking. 
We still tend to try to do things to students and not with 
them. 

5. The survey should reveal the advisership resources of the 
university staff. No activity program can operate success- 
fully unless the services of a substantial portion of the 
faculty are to be available. These services must be given 
willingly and must be characterized by insight and under- . 
standing of the activity program as a whole. This vital 
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community resource must be uncovered. If it does not 
exist in sufficient quantity and quality, the cooperation of 
the administrators who select new faculty personnel will 
need to be solicited. 

1 hese are only a few of the specific items with which such a 
survey should deal. What I propose is a thorough-going analysis 
and evaluation which will give a complete picture of resources 
and needs, strong points and weak points. I dare to predict that 
a survey of this scope on any of our campuses would reveal sur- 
prising data. I am positive that without this kind of survey as 
a foundation, we shall continue to temporize, to rely on trial and 
error, and, in the last analysis fail to reach our objectives of an 
adequately planned and integrated activity program. 

Accompanying this self-survey must be a careful formula- 
tion of educational objectives in terms of specifics. We cannot 
evaluate the effectiveness of what we have, nor plan to develop 
what we need, until we know exactly what our objectives are. 

I think I can make my point most quickly by one example. 
The phrase “education for citizenship” has been used in ed- 
ucational literature over and over again, especially in the last 
thirty years. Every institution in the country claims it is an 
objective. What, precisely, does it mean? There are so many 
different versions of this concept that, like the word “democ- 
racy,” it has no literal and generally accepted meaning today. 

I think you will agree with me that despite all of our talk 
about it, we have accomplished precious little in training our 
students to be responsible and effective citizens in our society. 
I am positive that we never shall, until we are able to translate 
vague generalities into specifics. When I say specifics, I mean 
specifics of a very simple type. It is not enough, for example, 
to translate responsible citizenship in terms of “insight, good 
will, and participation.” These are other generalities that in 
turn need re-definition. We must think it through to the point 
that “education for citizenship” is broken down into categories 
of attitudes and behaviors which are deemed to be desired and 
which are observationally tangible. Then all who teach, or ad- 
vise, or administer, can know for what portion of such specific 
categories they are responsible. No doubt such a program will 
require basic changes in curriculum and teaching methods as. 
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well as counseling and the student activities program. My 
point is that we have been content with generalities for our 
objectives. They must be thought through and translated into 
more behavioristic categories so that we shall be able to measure 
our effectiveness and to identify the phases in our program 
which are nor producing results. I do not generally recommend 
that army procedures be followed, but the idea of “mission” 
or “duty orders" is a good one for us to consider. The Com- 
manderdn -Chief gets his orders in terms of the mission in 
general. His orders are to destroy the enemy war machine. 
This is translated into thousands of orders going to Armies, 
Corps, Divisions, Regiments, and Battalions, and sometimes even 
to lower echelons. In each step down in the hierarchy the or- 
ders become more detailed and more specific. So with our goals. 
In planning we start with the general objectives which should 
be translated into specifics until the Adviser of a Debate Club 
or the lowest ranking teacher of freshman English understands 
his or her immediate responsibilities. 

If we can get this kind of translation of goals and combine 
it with a comprehensive survey of resources and needs, then w r e 
shall be ready to plan a coordinated activities program which 
can be educational in character and integrated at every point 
to the entire life of the campus. 

There are some problems related to student activities which 
will present special difficulties in attempting to plan a program. 
These problems exist on all campuses, although they will vary 
in detail from place to place. If our plan is to be complete, we 
will be required to find the answers to all of them. 

One of these is a problem which we have considered many 
times. It was the subject of the opening session of this meet- 
ing, How are we to secure faculty cooperation in the personnel 
program? In view of this discussion, there is no need for extended 
comment on it. Let me say simply that important as it is 
with respect to the counselling program, it is imperative for 
the success of the activities program chat an answer be found. 
The need is even greater chan for mere cooperation. When you 
speak of ‘‘cooperation 1 ' it implies that one group (personnel 
workers) are to be assisted in their task by another group (the 
faculty). The fact is that we are, or should be, one group. We 
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should all be teachers, We should all be personnel workers 
The problem, then, is not to develop cooperation, but to see 
to it that the personnel point of view permeates the entire 
staff of our institutions. We need to involve the faculty in the 
personnel program, not to get them to cooperate with it. The 
educational process is all of one-piece We shall never reach 
our objectives, in my judgment, until we lose entirely the dis- 
tinction between the curriculum and the rest of the institutional 
life, and also think of students, faculty, and administration as 
fellow members of the university community. 

Allied with this problem is the matter of the training of ad- 
visers. Assuming that we are successful in involving more and 
more of our faculty in the personnel program, those who serve 
as advisers to student gioups and activities will need to develop 
special competence. The teaching which must take place in a 
student activity is of a different kind than that which is char- 
acteristic of teaching subject matter. Our advisers must be 
aided in developing these techniques Specialists in group work 
will certainly need to be related to our personnel organizations 
for that purpose. Our planning must take this into account. 

There is one more problem related to the adviser to which 
no answer has yet been found What should be the relationship 
between adviser and the student group? Our practice varies 
widely. An athletic coach and his team has one type of relation- 
ship, advisers to departmental clubs another, and advisers to 
student governments still another. Probably there cannot be 
uniformity, but the relationships for each classification of 
activities need to be thought through better than we have 
been able to do up to now. We have been too content to accept 
the relationships which have evolved by accident. 

The planning process needs to concern itself with the prob- 
lem of “leadership training,” as it is usually called Most cam- 
puses have experimented in this direction, many with good re- 
sults. Motivated by the necessity to give newly elected student 
leaders some assistance in preparing for their new responsi 1 - 
ities, we have sponsored “leadership training weeks’ or other 
set periods when the knowledge and skills required have been 
discussed. I wonder if there are not some fallacies in our thinking 
thus about this problem. Would we not be planning more surely 
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If we stopped the notion of “leadership training,” as such and 
thought of it as “continuing orientation to new responsibili- 
ties.” This is more than a quibble on words or titles. Continu- 
ing orientation to new responsibilities implies that the train- 
ing oflcaders is a continuous process, not a matter for a special 
week or other period. It ini [dies also that it should be a develop- 
ment and an extension of the freshman orientation programs 
continued throughout four years. Why should we limit this 
kind of training to a few who arc selected for student offices? 
If generally included as a continuing process in an orientation 
program, many students would be helped to develop leader- 
ship potentialities who now never get their heads above the 
crowd, Continuing orientation to new responsibilities also has 
the merit of including participants as well as officers in the 
training program. In confining our assistance to officers only, 
we shirk an educational responsibility to most of our students. 
The world and the campus need better leadership, but both 
need, perhaps even more desperately, intelligent and effective 
participation. 

Continuing evaluation of the program as a whole, and of 
each activity composing it, should be included in our plan. The 
self-survey would represent an initial evaluation, but anything 
less than an annual evaluation is insufficient to keep us on our 
course. Various techniques can be developed for this purpose 
and the evaluation procedures can make important contribu- 
tions to the orientation process just discussed. All of us know 
that continuing evaluation is important. Few of us do it sys- 
tematically and annually. 

The problem of participation will present real difficulties as 
we plan. On most campuses coo few do too much, and too many 
do nothing, in the activities program. Nearly all of us have 
rejected the notion that participation in activities should be 
a requirement for graduation. I have always agreed with this 
view. Yet, I know that we are graduating hundreds of stu- 
dents every year who desperately needed the educational 
experience of participation. Either we must look again at our 
attitude coward requiring participation, or our orientation pro- 
grams must do a better job of motivating students so that they 
are eager to participate. Our own experience indicates that with 
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better planning with an eye toward increased participation, 
some progress can be made. We took a look at our program in 
dramatics. It was a fine program in that the productions were 
extremely well done Critics praised them as having a profes- 
sional touch. But the number of students involved was small. 
They were the ones who already had superior talent. We then 
discovered that there were scores of others who were interested 
but did not participate because their talents were not up to 
the standard required. From our Counselors we knew that 
there were other scores who needed the experience in whom 
the interest might be developed. Without going into detail, 
we embarked on a new program. Without giving up the orig- 
inal program, we are now attempting to provide opportunities 
in drama for all who are interested at every level of ability. 
Some day we hope we shall be able to do this with all activi- 
ties. In our planning, the problem of participation must be 
met. If the experience in activities is an essential element in 
the growth of the individual in college, it will be difficult to 
justify a program which provides such opportunity only for 
a few. 

The problem of continuity of personnel is another problem 
to be met. Our students are with us for four years at the most. 
If the Junior College Movement is expanded, as we may well 
expect, we shall have many for only two years. Our plans must 
be made in the light of the fact that the program for each stu- 
dent is a short one. If we are able to develop a sound program 
of continuous orientation, some of the serious aspects of this 
rapid turn-over in personnel will be solved. Each new group 
moving in to the activity for the first time will be prepared for 
effective participation. As it is now, too many of our students 
just begin to reach that stage upon graduation 

So-called student government involves special problems 
which, I am convinced, are being met on few of our campuses. 
There are good reasons for this. The art of government, espec- 
ially self-government, is one of the most difficult. Our daily 
newspaper proves this beyond need of further proof. My own 
conviction is that one reason for our failure to do better wit 
it on our campuses is to be found in the unrealistic phiiosop y 
which we have permitted, and even encouraged to be developed, 
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concerning it. The very phrase “Student Government” is a 
misnomer and makes inevitable much of the confusion and 
frustration which develops. This term implies that students 
are self-governing, or can be, in some well-defined and signifi- 
cant area of university affairs. This simply is not so. From the 
legal point of view, most colleges and universities have char- 
ters which place responsibility for government on trustees, 
president, other administrators, and faculty, There is a limit 
to which this authority can he delegated to others. Therefore, 
if you insist, as many who are interested in this problem do, 
that the authority of students to govern themselves in well- 
defined areas shall he complete, you inevitably doom student 
governmental activities to the superficial and the inconsequen- 
tial. There are few faculties or administrators who could, if 
they would, delegate complete authority to students in matters 
of serious consequence. In fact, I will go so far as to say that 
they should not if they could. We bemoan the fact that there 
is a dichotomy between students and faculty which seriously 
interferes with the learning process. Why should we then es- 
pouse a philosophy of government which declares to students, 
faculty, and administration separately, "this area is your ex- 
clusive prerogative. If the university is a community of all 
three, and if its success depends upon the development of unity 
and integration between all three dements, then let us stop 
talking about student government, and devdop a philosophy 
of community government in which students can participate 
as full partners. The logic of this thinking seems to me unas- 
sailable. If it be sound, it will have important repercussions on 
our traditional student government organizations. They are 
unsuited to this community concept in most instances. I yield 
to no-one in the matter of strength of conviction that students 
should participate in all significant aspects of university gov- 
ernment. If we can have the wisdom, the courage, and the 
skill to persuade all three dements of our community to un- 
shackle themselves from traditional forms and an unrealistic 
philosophy in the matter of university government, we will 
have made a great move forward. 

Lastly, just, a brief word about a problem which is bound 
to become more acute as the armed truce in which we find our- 
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selves engaged alternates between colder and warmer tempera- 
tures. If we are to train students to live effectively in their 
world of today and tomorrow, they cannot be insulated from a 
discussion of controversial political, economic and social mat- 
ters Surely this point needs no elaboration. On the other 
hand, this nation is engaged in a conflict which in many re- 
pects is the most desperate, difficult, and decisive of its entire 
history. We are dealing with an adversary who accepts the 
principle that his possible success in destroying our way of 
life justifies any method without scruple. We are dealing with 
persons who insist upon using our personal rights in order 
that they may gain power to destroy the rights themselves. 
We are dealing with a type of attack which emphasizes the im- 
portance of gaining influence primarily in the ranks of labor, 
in our schools, and on our campuses. When we plan our pro- 
gram, may we have the wisdom and the courage to be true to 
our democratic principles, to be consistent with our educational 
objectives, and at the same time to safeguard our campuses 
from being used as sounding boards for undemocratic philos- 
ophies which deny the validity of our most basic concept, the 
integrity and innate value of human personality. 

I have suggested to you that we undertake a big job I do 
not minimize the difficulties, but I agree with one of the speak- 
ers at last year's meeting that it is time we stopped being sat- 
isfied with the minimum essentials in a personnel program. 
Our practices in the field of student activities fail to measure 
up to our knowledge of what should be done. Our knowledge 
of what should be done, and how, is but an insignificant por- 
tion of the understanding we can develop. Each of us has a 
responsibility to do as much as we can and then to share with 
others the results of our labors. If we attack these problems as 
a profession and can develop better facilities for communicat- 
ing results to each other, the program for which I plead in 
this paper can become a reality. 
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Thk major responsibility of education is the preparation of 
the individual for effective living, I lowever broad this definition 
may he, in a simple operational sense no one can live effectively 
unless he* can make friends, get along with people, and be self- 
supporting. His social adaptation and vocational adjustment 
are usually related if he is to derive satisfaction from earning 
a living. Since about 90 per cent of all adults do marry, the 
achievement of a harmonious family life becomes another meas- 
ure of effective living. 

Successful social, vocational, and marital adjustments, in- 
tercorrelated as they arc, underiy and accompany emotional 
stability and personal happiness. Their realization integrates 
the individual and makes him a valued member of his com- 
munity. Failure to achieve any one of these goals may be par- 
tially compensated for by success in the remaining two, but 
failure in two goals almost certainly means unhappiness and 
maladjustment. When neitherof the three objectives is achieved, 
only misery, sometimes insanity, and even suicide can follow. 
One Index of marital maladjustment is the fact that nearly 
one marriage in every three ends in divorce. 

Colleges and universities have long recognized the importance 
of guidance. In many ways they have helped students achieve 
academic acceptability and have provided opportunities for 
more effective social participation. Substantial progress, of an 
unusually high order at some institutions, can be noted in 
vocational guidance but little marital counseling is in evidence. 
Many colleges, it would seem, take the position that a short 
series of lectures will be sufficient to prepare the student for 
marriage. Even these lectures, oftentimes elective and carrying 
no credit, may be more concerned with the structure of primi- 
tive or contemporary family life than with individual prepara- 
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tion for marriage. Such an approach to gaining insight into 
mathematics or to acquiring an appreciation of literature would 
be considered ridiculous by most college administrators. 

Much more is involved than just introducing “a course in 
marriage” there must be a fundamental change in educational 
philosophy if a really comprehensive and worthwhile program 
is to be undertaken. A sound philosophy must recognize: (i) 
that many children receive little training (either at home or in 
public school) in marriage and family living, and that colleges 
must supplement this training; (a) that courses, whatever the 
number of semester hours (certainly not less than required in 
compulsory composition and literature courses), must be prac- 
tical and realistic and directed toward preparing the individual 
for marriage; (3) that opportunities for meeting the other sex 
must be provided along with wholesome activities in which 
couples can participate; (4) that competent counseling shall be 
available to any student having problems in sexual or premari- 
tal adjustment; (5) that counseling shall be available for dating 
or engaged students or couples who wonder if they are ready 
for marriage or have problems relating to their approaching 
marriage; (6) that when a student or alumnus marries and has 
trouble in holding his marriage together, he should be able to 
turn to his alma mater for help. Finally, more colleges and 
universities should encourage research in marriage and some 
must accept the responsibility for training marriage counselors 
and preparing teachers who will be qualified to teach marriage 
courses. 

The School of Education at The Pennsylvania State College 
began, over a decade ago, to develop a more comprehensive 
program of student guidance. Through its Psychological Clinic, 
a laboratory for graduate students looking toward the profes- 
sions of school psychologist and clinical psychologist, personal, 
educational, and vocational guidance were available to all stu- 
dents. During Freshmen Week new students had administered 
to them an extensive battery of tests covering intelligence, 
scholastic achievement, vocational interests, and certain aspects 
of personality, Faculty advisors received profiles of test results 
and generally referred to the Clinic any students needing in- 
dividual guidance. It became increasingly evident that many 
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students had problems relating to heterosexual and premarital 
adjustment. 

The Departments of Home Economics and Sociology were 
offering general marriage courses but none was specifically 
available for students preparing to be teachers or psychologists 
Almost simultaneously the Departments of Psychology and 
Sociology inaugurated separate new courses in marriage, each 
concerned with individual preparation for marriage. The course 
in the Department of Sociology, open only to seniors, was of- 
fered one evening a week and carried one semester hour of 
credit. Its lecture staff included sociologists, psychologists, phy- 
sicians, and home economists. In the Department of Psychol- 
ogy, the description of its new course read: "Psychology of the 
development of heterosexual adjustment and the mechanisms 
of sexual adjustment in adolescence, adulthood, and marriage; 
psychological techniques available in selecting a mate and for 
evaluation of factors important to successful marriage and 
parent-child relationships.” This elective course, open to both 
juniors and seniors (later to any students having three to six 
credits in Psychology and Sociology), was offered for three 
credits and is now required of all students majoring in Clinical 
Psychology. Coeducational, the males outnumber females by 
four to one, reflecting the general college sex ratio. 

It is not easy to appraise the effectiveness of courses in mar- 
riage but there ts some objective evidence that men students, 
and women students majoring in Home Economics, have fewer 
divorces and make more successful marriages than students 
who do not take such courses. 

Because of student demand, especially from majors in Edu- 
cation, Psychology, and Sociology, a second three-credit course, 
open only to upper classes and graduate students, was under- 
taken at the beginning of the war. This course is described as 
"principles of guidance in sexual and marital adjustments, 
analysis and measurement of traits basic to these adjustments, 
marriage-happiness prediction techniques, and principles and 
materials of sex education for teachers in secondary schools.” 
Today this course might be considered as an introduction to 
marriage counseling. 

Our graduate course, Clinical Techniques in Marital Coun- 
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seling, is open only to mature graduate students who are work- 
ing for a doctorate in Clinical Psychology. It is a practicum 
course in which each student is regularly assigned problem cases 
under the supervision of senior staff counselors, but before he 
is permitted to handle premarital and marital problems he must 
have demonstrated in other clinical courses ability to deal suc- 
cessfully with personal and vocational guidance. 

The clients coming to the Marriage Counseling Service can 
be divided into five main types 1 

i. Students with a personal maladjustment such as an in- 
ability to get dates, or to achieve satisfactory sexual adjust- 
ment. 

i Couples contemplating engagement or marriage who have 
questions about their compatibility 

3 Engaged couples with special problems such as mixed 
religions or parental disapproval 

4. Couples living on the campus who are having difficulty 
in making their marriage work. 

5. Alumni or faculty members whose marriages are in trou- 
ble. 

In the preliminary interview the client usually states why he 
lias come to the Clinic. The nature of the problem and its degree 
of seriousness largely determine what clinician will be assigned 
to the case If tests are indicated at the time, as when a couple 
are uncertain about their compatibility, appointments foi their 
administration are made. The general battery consists of the 
German Prediction Scale oj Happiness, the Adams-Lepley Per- 
sonal Audit , and the Guilford-Martin Personnel Inventory A 
married client ordinarily completes the Adams Marriage Ad- 
justment Index which is a fair indicator of the level of the 
individual’s marital adjustment or satisfaction. The Minnesota 
Multi phasic, the Rorschach, or other tests may also be adminis- 
tered. Such objective measures and further interviews may lead 
to a diagnosis of the problem and help determine the therapy 
to be employed. 

The less experienced the counselor, or the more complex the 
problem, the greater the likelihood that a non-directive ap- 
proach will be followed, since this technique offers the least 
possibility of damage to the client. As Snyder has pointed out, 
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a case history is not essential in non-directive therapy since 
“the counselor does not give advice or offer solutions to the 
problems raised by his client"; instead, the best technique 
would be “to clarify the feelings of the client" and, at times 
“to structure the situation indicating the responsibility of the 
client in the counseling process, and that of the counselor. 1 ’ 
Tests or bibliotherapy would not he employed except at the 
client's request. Whatever the counseling approach, it is stand- 
ard practice that the same counselor not work with both male 
and female, or with both husband and wife. 

In the less non-directive approach, the counselor adheres to 
some form of the scientific method of investigation. Through 
tests and interviews, a case history is developed. These accum- 
ulated data, with the client taking the more active rSle, are 
classified and evaluated. As the client defines his problem, his 
feelings and attitudes are revealed. On the basis of the relevant 
and significant facts and feelings, some tentative diagnosis (la- 
bels arc not used! emerges, out of which may come a plan of 
attack that the client accepts and wants to try. Progress reports 
may lead to modifications of the plan, or to the development 
of a new plan. This process continues, and is repeated, until 
the client has solved his problem or established tension-reducing 
devices that enable him to live with it. 

Most counselors feel that no therapy should be attempted 
until fairly complete Information has been given and received 
and some attempt made at diagnosis. The case history may 
enable a separation between the predisposing and precipitating 
factors underlying the problem. Certain questions must be 
raised if a workable solution is to be achieved. What motives 
does the client have and to what degree are they being satisfied? 
What needs exist and what can be done to fulfill them? What 
are the client's assets and resources? What are his limitations 
and liabilities? The answers to these questions, whatever coun- 
seling approach is followed, may require many interviews before 
an accurate diagnosis results and a plan of therapy is evolved. 

All of us would agree that the counselor’s initial role is to 
listen. Listening may, in itself, result in bringing the client’s 
feelings and attitudes into the open, may reduce tension, may 
lead to a definition of the problem, and may help the client gain 
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insight into what he can do to solve the problem. The counselor 
will assuredly give the client relevant information, will help him 
evaluate data bearing upon his attitudes and present and future 
behavior, and will collaborate with the client in interpreting 
the facts. 

At the outset, the counselor — and later the client — must 
realize that some personal and marital problems cannot be 
solved or “cured.” Through ventilation, emotional support, 
desensitization, and the development of balancing factors, a 
counselor may help a client face reality and tolerate even an 
unsolvable problem 1 

The counselor must be neutral and objective. No good coun- 
selor can be moralistic or make value judgments. That is why 
it is often difficult for a teacher or a dean of students to be an 
effective counselor — he must uphold and maintain the institu- 
tion’s rules and regulations and, at the same time, not fix blame 
upon the student who violates them. Conflict is inevitable — for 
both the counselor and his client. The dean may be forced to 
concentrate upon the violation to prevent its recurrence; when 
that is the case, the violation becomes the problem rather than 
a symptom of the problem, and the client suffers. A symptom 
should be viewed as a protective mechanism, or a device the 
client utilizes in his efforts at adjustment Drinking, premarital 
promiscuity, adultery, and many other behaviors are symp- 
toms, To take away a symptom, whether by authoritative com- 
mand or hypnotic suggestion, without replacing it with some- 
thing equally adjustive or tension-reducing, is to render a 
disservice to the client. 

If the symptom produces pain, it may need relief whatever 
the technique, whether catharsis or hypnosis. Just as a physi- 
cian anesthetizes before undertaking repairs, the counselor may 
have to relieve his client’s feelings of guilt or shame or sin be- 
fore a program of re-education or reconditioning can begin. The 
moralistic counselor cannot do this because he is too conscious 
of social approval and disapproval. Without realizing what he 
is doing, he may force a client to look at a painful fact long 
before he is able to do so. This may lead to deeper feelings of 
unworthiness and shame and lessen the client’s self-esteem and 
sense of integrity. Until the client can understand the why of 
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this file t or of this adjustive mechanism and can be helped to 
r ationalizc nr justify it. he should not be forced to face it. 

On many college c .mijnn.es today the majority of students 
may be veterans. Many of them are married. Their problems 
are legion , oftentimes aggravated by maladjustment during 
military service, jwsent limited incomes and financial burdens, 
and the heavy load of maintaining family life and pursuing an 
education. Disturbing as many of these problems are, they 
become ujwctting and distressing when the couple have neither 
satisfying companionship nor sexual compatibility. They need 
counseling if their marriage is to succeed. Sometimes palliative 
or supjNirtivc therapy will see them through; sometimes their 
problems arc so severe that the best adjustment therapy may 
fail. 

At Penn State, our results have been encouraging but not 
spectacular. Our follow up of counseled couples seems to in- 
dicate that about one marriage in five becomes quite successful, 
another two are perhaps of average quality, a fourth is tolerable 
if licit successful, and a fifth terminates in separation or divorce. 
Remembering that some of these problem marriages did not 
consult us until in cx/rrrnis. the record suggests that counseling 
can be worthwhile. 

The number of psychologists and psychiatrists in this coun- 
try, if they were all qualified to do marriage counseling, is too 
small to do the job. The American Association of Marriage 
Counselors, a professional organization of trained counselors, 
has less than one hundred members, and they come from several 
different disciplines, including medicine, psychology, sociology, 
psychiatry, and social work. It will he many years before the 
number of competent counselors will be great enough to supply 
the needs of colleges and universities. When those needs are 
met, barely 10 per cent of our population can be served. And 
we arc faced by the fact that some school and college adminis- 
trators shy away from anything remotely resembling sex edu- 
cation, preparation for marriage, or marriage counseling. We 
must first look toward preventive rather than remedial meas- 
ures. 

This year in the State College High School, several specialists 
organized and presented to the seniors a series of lectures in 
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sex education and prepartition for marriage There is nothing 
unique or unusual about the content or methodology of the 
course. It does differ in two ways from many similar courses' 
first, each week the parents of the seniors hear the lectures that 
will be presented to their sons and daughters the following week, 
second, plans are under way for training the regular teachers 
so they can offer the course without outside help. We hope this 
procedure will build a deeper and more understanding relation- 
ship between the parent and child, the teacher and the child, 
and the parent and the teacher And, with the help of our State 
Department of Health, the College hopes to offer teachers 
training in this field beginning with the summer of 1950. If our 
program can develop, it will not be long before many high 
schools in Pennsylvania will have at least one teacher qualified 
to present material in this area and to do some counseling. 

If schools and colleges could be persuaded to give realistic 
courses in preparation for marriage, and to supplement them 
with effective premarital and marital counseling, another gen- 
eration might not have 40 per cent of its marriages destined for 
separation or divorce. 
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I have had some, mixed feelings about my participation 
in the topic under consideration at this session. Placement 
and follow up activities are a phase or an area of student 
personnel services in which I have had a definite interest, and 
1 certainly regard it an honor to share in the presentation of 
this topic with Dr. Hndicott. However, I do not wish to pose 
as an expert or lead you to believe that I have had long years 
of experience in the placement field. My comments, or what 
contributions 1 might make, will be based largely on my ob- 
servations and experiences as a counselor in various guidance 
and personnel programs, and on our recent experiences at my 
own institution in setting up a placement program designed 
to be integrated with the student personnel program of the 
University. 

I think wc would all agree that the topic is a timely one and 
that we arc all confronted with a very real challenge in achiev- 
ing an effective placement and follow-up program. Many col- 
legiate institutions throughout the land have pointed with 
pride, and perhaps rightly so, to their increased enrollments 
following the cessation of hostilities and the many problems 
they have had to resolve in providing adequate instructional 
programs and facilities. There is some doubt, however, as to 
the number of colleges and universities who can point with 
pride to the adequacy of their student personnel programs, and 
more specifically to the adequacy or effectiveness of their place- 
ment service and to its integration in their student personnel 
program. The need for the latter is becoming increasingly 
more important as the labor market eases and the inexperi- 
enced college and university graduates will encounter more and 
more difficulties in locating suitable job openings. 
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Placement and follow-up services, from an historical point 
of view, have long been identified with, or considered an integral 
part of, a vocational guidance program, and have been 
repeatedly listed in recent years as one of the basic or essentia] 
student personnel services on the college level. It should not 
be necessary to stress the fact that it is an integral part of a 
student personnel program since effective placement has come 
to be recognized as the culmination of many efforts to assist 
students in the preparation for a satisfying and constructive 
post-college life. The real problem, or I should say the lack 
of it, is that which is so well expressed in our topic heading: 
“Integrating Placement with the Student Personnel Program.” 
There appears to be considerable agreement among authorities 
in the student personnel field that placement or employment 
services are not, in practice, an integral part of the personnel 
program — that counselors and other personnel workers con- 
tribute very little to placement work and that their informa- 
tion about students is not used by placement personnel 

Before reviewing some of the areas and/or techniques by 
which placement may be better integrated in a student per- 
sonnel program, I should like to comment on two factors 
which I believe are basic or are prerequisite to all other con- 
siderations. 

1 . It seems to me that the first step in achieving the desired 
integration relates to the manner in which the placement ser- 
vices are organized. I do not feel that the unfortunate lack of 
coordination or integration will be satisfactorily resolved unless 
the “principle of definiteness of assigned responsibility” applies 
to placement as well as to any other personnel function. This 
principle relative to administrative structure is very well pre- 
sented by a special committee of the American Council on 
Education in their preliminary draft of “Revision of the Stu- 
dent Personnel Point of View.” 

We recognize that there are many factors which will deter- 
mine the specific form of organization of the placement services 
at any given institution and that it is not possible to blueprint 
an organizational structure which will meet the needs of all. 
We know, for example, that in many large universities the 
various departments, schools, or colleges operate separate place- 
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ineW muv k cw for their own specialized students. There are 
some advantages m this type of decentralized placement service 
as the faculty in the respective colleges and/or departments 
know their students well and often have a personal acquaint- 
ance with employers who rely and depend upon their 
judgement There arc i ci tain other advantages in this decen- 
tralized plan in that the faculty of the specialized schools 
have an opportunity to keep in dose contact with employers 
and with developments in their respective fields. They find 
it possible, through frequent meetings with employers, to keep 
informed of needs in the field and thereby effect desired changes 
in the curriculum. 

We know- that in other institutions the placement and follow- 
up services are all centralized in one office and administered 
by a Director of Placement or a placement officer having a 
comparable title and duties. The Director of Placement in 
this organizational category may have, depending on the size 
of the institution, one or more assistants who will specialize 
in certain areas of placement and who work very closely with 
the faculty of the departments or schools related to their 
functional or specialized areas of placement service. This type 
of organizational structure has certain advantages in that there 
is a central source of information on placement opportunities 
and vocational trends; there is a central file of information 
on candidates; there is convenience of location for employers 
seeking candidates for job opportunities; and there are certain 
economics in this type of operation. It has also been suggested 
that a centralized placement program could make for a more 
objective review and screening of all possible candidates for 
a particular job referral. The idea here is that the “halo” effect 
can also work in the reverse in a more subjective approach in 
some decentralized placement plans. 

We also know there exists in practice certain combinations 
of centralized and decentralized forms of placement within 
the same institution. This may take the form of centralization 
of files and records in one office, but decentralization in terms 
of function. For example, a placement counselor or representa- 
tive from a college of commerce and finance will assist personnel 
men from the business field; a representative from a college 
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of engineering will meet with personnel men from industry, 
etc. We could go on and briefly describe other types of organ- 
izational structures such as those placement services which 
are an integral part of a vocational guidance or Counseling 
Bureau. However, I believe the foregoing describes the major 
organizational structures in practice. 

If the size of the institution is such that it is deemed necessary 
or more feasible to operate on a decentralized plan, then one 
solution in achieving the desired coordination may be through 
a central placement office operated under the supervision of 
a Director of Placement or Coordinator of Placement. This 
Director or coordinating officer could, in addition to providing 
a central registration service, keep in touch with the activities 
of the decentralized units, coordinate their efforts, and main- 
tain a close contact with their specific placement problems. 

I believe we have to be realistic and to recognize that in many 
institutions some of the colleges or departments will strive 
to retain their autonomy. Though I would personally favor 
a centralized placement service operating under a Director 
of Placement, with the assistance of specialized placement 
Counselors, yet I am aware of some very real problems in 
achieving this type of organization in actual practice However, 
in the absence of any centralized system or coordinating office, 

I often think of the plight of the Liberal Arts graduates or, 
for that matter, the graduates of more specialized departments 
who may receive little or no assistance from their respective 
decentralized units and yet who may qualify for several types 
of job orders which may have been directed to only one depart- 
ment, school, or college within the institution. Problems of 
this type will become more and more real as the labor market 

eases. . 

1 . A second major step or prerequisite in achieving integra- 
tion of placement in a personnel program relates to the quali- 
fications of those engaged in directing, coordinating, or 
functioning as placement counselors. If helping an individual 
to secure suitable employment is the culmination of many 
efforts to assist him in achieving a satisfactory vocational 
adjustment, then it follows that all pertinent information about 
the individual should be brought into focus on this problem. 
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I have in mind here information relative to counseling and 
testing data, academic achievement, co-rurricular experiences 
mental hygiene reports, health status, etc. This implies skill- 
ful evaluation and keen insight into the dynamics of vo- 
cational adjustment. The Director or Coordinator of Placement 
should certainly possess the minimal academic training recom- 
mended in a discussion last year at this convention on the 
topic: "Professional Standards and Training for College Per- 
sonnel Workers. ” As some of you recall, that was a Master’s 
Degree in Psychology, Business Administration or Education, 
with emphasis on vocational problems, and special training 
in occupational! analysis and information, office management, 
record systems, etc. It hardly need he stressed that he should 
also have some experience in business, industry, and/or educa- 
tion, It would also be most desirable if he had faculty rank 
and participated in committees which related to vocational 
adjustment services. If the placement personnel do not have 
the minimal training and work-experience qualifications, and 
secondly, if they do not have faculty status, there is a real 
danger that the activities of this office are construed to be 
largely clerical in nature. If the foregoing conditions are not 
met, at least with respect to minimal qualifications, it is no 
small wonder chat counselors and other personnel workers con- 
tribute very little co placement work and their information 
about students is not used by the placement officers. In general, 
if the placement personnel, outside of the necessary clerical 
staff, have the academic qualifications at least comparable 
to educational and vocational advisers, I do not think we 
need to concern ourselves too much about their not finding 
ways and means of obtaining the coordinating information 
necessary for effective placement services. 

It may appear to some of you that I have concerned myself 
too much thus far with the organizational aspects of placement 
service. I do not feel, however, that much will be accomplished 
in the way of integration or of fitting the placement service? 
into the over all student personnel program unless there is 
“definiteness of assigned responsibility” for this service, and 
secondly, qualified personnel to carry out the job effectively. 
For the balance of the time allotted to me, I should like to 
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review with you some of the areas and/or techniques of in- 
tegration. 

1 Pre-college Counseling and Selection • This area is one in 
which many institutions would readily admit there is a glaring 
weakness in their over-all student personnel program. Most 
colleges need go no further than to analyze their own student 
mortality figures and relate them to the frustrations, dis- 
appointments, and feelings of defeat which they represent, for 
the most part, if interpreted in terms of individuals rather 
then viewed as abstract statistical summaries. We recognize 
that effective placement is the culmination of many efforts 
to help the individual achieve a satisfactory vocational ad- 
justment. However, those responsible for placement can, in 
a very real way, make an important contribution to the be- 
ginning of the educational and vocational adjustment proc- 
ess. Would it not be a fair question for the prospective college 
student to inquire as to where the graduates of a given college, 
school, or department are getting jobs; what are the require- 
ments and current and future trends as interpreted in the light 
of the experiences of the institution as contrasted to the very 
general and sometimes vague information contained in pub- 
lished occupational materials. Though there is yet much to be 
learned in the science or techniques of occupational forecasting, 
yet our placement officers have a definite responsibility in 
making available as much of the above information as is possi- 
ble to those directly concerned with pre-college counseling 

and selection. . , 

This business of gaining admission to colleges or universities 
is too often a one-sided approach. All collegiate institutions 
generally require the prospective student to give a full account 
of himself before he is admitted. Is there not an equal obligation 
for the institution to give a full account of itself to the appli- 
cant; before he enrolls? 1 1 hasten to add that this accountability 
should not only relate to vocational opportunities but also to 
the adequacy of instruction and other student personnel 

services. , , , t 

1. Orientation Programs: The foregoing remarks apply to some 

> Archibald Macintosh. Behind the Academic Curtain. New York. Harper & Brothers, 
1948, p. 146. 
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extent jtn rite insti ration's program of orientation for new stu- 
dents We know that many students will continue to apply f or 
and accept admivumi without much knowledge of themselves 
or of the aims and objectives of the college in which they are 
enrolled Placement officers could participate in these programs 
and help students to achieve orientation not only to the place- 
ment services available to them hut also could assist them in 
acquiring greater insight as to the vocational opportunities 
they <«»nld reasonably look forward to upon successful comple- 
tion of their course of training. 1*'nr example, how many of you 
have been coma* ted hy students from Liberal Arts Colleges, 
who, though quite happy in their present course of study, are 
apprehensive over the vocational opportunities which will be 
available tet them. And yet. there is evidence to indicate that 
many employers would encourage a student: to acquire a broad 
educational background; that they place a very high premium 
on his over all intelligence, on his ability to get along with 
others, anti that they express considerable interest in the na- 
ture and extent of the student's out of classroom experiences. 
If this he true, and if each institution could support this point 
of view through adequate placement and follow-up studies, 
would it not do much to relieve the apprehension or fears of 
those who elect a broad program of studies. I feel confident 
that many Liberal Arts colleges and perhaps other schools and 
departments have not acknowledged nor realistically met this 
problem hy getting the facts through adquate placement and 
follow-up studies. 

1 do not wish to imply hy those remarks that a college, school, 
or department need have to literally guarantee jobs or neces- 
sarily “parade" vocational opportunities before them con- 
stantly in order to attract or hold students. You cannot, how- 
ever, ignore their concern and certainly the lack of information 
as to where their predecessors have found employment, their 
beginning jobs, the adjustments they have had to make, etc., 
only intensifies the problem. Moreover, if it is true that employ- 
ers weigh quite heavily the factor of co-curricular experiences, 
then it would seem that such information provided by place- 
ment officers would be of much value to those concerned with 
developing various student activity programs. Dissemination 
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of such information and its implication so far as the individual’s 
ability to get or hold a job should do much to jar the compla- 
cency and inei tia of many students who would be quite content 
to march through four years of college with little concern for 
their personal and social development. 

3 • Counseling and testing Service: There are many oppor- 
tunities for integration of placement in this area of student 
personnel services. Excluding those situations in which the 
placement office and a vocational guidance bureau are one and 
the same department, there is first of all a definite need for 
exchange of information relative to vocational or placement 
opportunities. One does not function as a Counselor for very 
long in a counseling and testing program without recognizing 
the inadequacies of much of the published occupational 
materials available to him. How he would like to supplement 
these materials with information more pertinent to his labor- 
__rn&id r et area, how he would like to bring to the attention of the 
counsellee more information as to the beginning jobs, the lines 
of promotion, and the adjustments former graduates or with- 
drawals had to make in one field or another of endeavor, how 
he would like to refer many to employers, former graduates and, 
yes, even to qualified placement personnel for more detailed 
information so that they might achieve greater insight to the 
occupation or vocational areas under consideration! 

Secondly, it also follows that the placement personnel would 
want to review and to study the information available from 
those engaged in the program of diagnosis and counseling so 
that all factors could be considered at the time of a specific 
placement referral. I feel reasonably certain that most Directors 
of counseling and testing programs would cooperate and make 
available information about students to qualified placement 
..personnel if they were confident that it would not be misused 
" or misinterpreted. I cannot conceive of this lack of cooperation 
and coordination if you have a student personnel program 
worthy of its name. 

Most of us would agree that an institution has a responsi- 
bility in the case of the academic “casualty,” and also to stu- 
dents who are forced to withdraw because of financial and 
personal reasons. When this responsibility is acknowledged and 
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implemented by a -v-tem rtf terminal interviews, it is quite 
rilntrms »lui needed srrvu e cmtld he rendered by placement 
j*c»,**wnv! in helping! wmic *tf tlicnc individuals achieve employ- 
ment more appropriate to their abilities or needs. 

4 Pitiuwtul Jt<h and Port- Vime Student Employment: There 
are many worthy and needy students making application for 
financial aids who might have their needs met in whole or in 
parr by art effective part-time student employment service. I 
am thinking hetc of something more than the "passive” type 
af student employment service which merely receives and lists 
incoming calk or inquiries for tempotary or part-time employ- 
ment. Could this not be more of an aggressive service in which 
definite efforts would l*e put forth to seek out: as many types of 
part -time and vacation employment opportunities as is possible, 

The value ol actual “on- the job" experience certainly sur- 
passes many psychological tests or other counseling techniques 
wc might employ in assisting the student in the vocational 
adjustment process. It certainly follows, therefore, that within 
the limitations of its labor market area, each College or Uni- 
versity should organize the part time and vacation employment 
of its students so that it docs relate to their educational pro- 
gram and vocational needs and thus have exploratory and train- 
ing values. 5 Unfortunately, there is much evidence to indicate 
that this is not the case and that the objective of most part- 
time employment services is financial and not educational. It 
is encouraging to note, however, that many colleges and de- 
partments are moving in the direction of developing various 
types of internship training programs for undergraduates as 
well as graduate training programs. It would seem that an 
effective placement service could promote or extend more of 
these programs in cooperation with the colleges, schools, or 
departments, 

5. Personnel Records: Much has been written and said in 
recent years about the necessity of keeping adequate personnel 
records and of their use in the improved understanding of, and 
service to, the individual student as he has contact not only 
with the classroom, but in all phases of his college or university 

* Donald E. Super, The Dynamics ttj f'acationa/ Adjustment. New York: Harper & 
Brothers, mi, p. I *1. 
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life. We made reference earlier in this presentation to the value 
of this information, from the point of view of the culmination 
of many efforts, in assisting the student in finding appropriate 
employment after leaving college. The implication of the use of 
this information is subsequently assisting alumni in further 
professional development is also quite evident. 

I am not interested here in becoming involved in a discussion 
of the “mechanics” of record keeping or of the advantages or 
disadvantages of centralized versus decentralized personnel files, 
etc I do feel, however, that placement personnel could provide 
much needed information to those directly responsible for the 
specific content or nature of cumulative personnel records. 
Aside from the counseling implications of an adequate system 
of personnel records, every college is faced with the problem of 
providing information to prospective employers of students 
who are, or were formerly, in training at the institution It is 
generally not difficult to furnish information relative to scho- 
lastic achievement, background of training, and the nature or 
extent of the student’s participation in out-of-class-room activi- 
ties The problem becomes more involved, however, in provid- 
ing information in the area of personal or mental qualities. It is 
in this latter area specifically that placement personnel could 
make an effective contribution to the institution’s system and 
nature of personnel records. Memories cannot be relied upon. 
Students do graduate or withdraw from school. Faculty people 
do transfer, take leave of absence, retire, and even die occa- 
sionally. Even employers are somewhat naive at times, as 
evidenced by the nature of their personnel inquiries. The latter 
would often imply or suggest that the faculty have a more 
sustained and intimate contact with students than is possible 
in most institutions of any size operating under a decentralized 
personnel program. The foregoing problems certainly suggest 
such questions as to what personality traits or attributes can 
an institution observe and rate with any validity, who should 
do the rating, and how often, etc.? It is much easier to ask the 
questions than to answer them. However, if placement person- 
nel are aware of the needs of business and industry and the 
type of personal information they desire on the one hand, and 
the limitations of the institution’s personnel program on the 
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oilier. to fh.it extent » mild they provide effective counsel and 
information m helping others resolve these personnel record 

problem-. 

ft ('*, ('wriruiar Program*: If has often been stated that 
iriorc people fail in the work a -day world not because of a lack 
of t»lelbi;en»e. skills, or special knowledge, but rather because 
of their usability to t*et along with others. Many institutions 
arc. there loro, becoming increasingly concerned about the per- 
sonal and social development of their .students and are attempt- 
ing to provide and integrate a well- -balanced co-curricular pro- 
gram on their campuses, As was suggested earlier, placement 
personnel could assist those in charge of these programs in 
[minting tip the importance of social and recreational activities, 
and even Miiiurstirtg types of activities that have meaning for 
employers or certain types of work. 

7. Kfufttn/im Program u Another recognized dement of a 
student personnel program is that of a continuous evaluation 
of student personnel services and of the educational program 
to insure that students will achieve the objective for which the 
program is designed. Through their contacts with business, 
industry, and professional fields, placement personnel can con- 
tinually “ feed" back information to the appropriate schools or 
departments which may suggest or warrant further study or 
investigation with reference to possible curriculum changes. 
This may include information on job orders which could not 
be filled because the graduates lacked certain training or course 
combination 1 * deemed important, as well as pointing out fields 
in which there is a temporary over supply or evidence of long- 
time trends in this direction. In a similar manner, placement 
personnel could "feed" back information to those directly con- 
cerned with educational and vocational counseling with respect 
to adjustment problems experienced by former graduates, 
employer evaluations, etc. 

Summary 

If we arc to do more than merely acknowledge placement 
as an essential student personnel service, and if we are to do 
more than merely give 11 lip” service to the need for integration, 
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then I firmly believe that the following prerequisites must be 
met: 

1 That the responsibility for placement services must be 
definitely assigned 

2 That the individuals charged with the administration or 
coordination of placement services be responsible to the office 
having over-all administration and coordination of all student 
personnel services. 

3. That there be qualified personnel to discharge effectively 
the duties and responsibilities incident to placement and follow- 
up services 

An attempt has been made in this presentation to indicate 
the limitations, from the point of view of integration, of a place- 
ment program dependent entirely on the efforts of individual 
instructional departments, schools or colleges within an institu- 
tion This was in reference, of course, to those institutions in 
which there were no central placement or coordinating offices. 

If the foregoing prerequisites have been met, then it would 
seem relatively easy to identify areas of integration as well as 
to develop specific techniques of integrating placement with the 
student personnel program, Admittedly, I may have been think- 
ing in terms of perhaps the “ideal” or the optimum program, 
but should we set our sights any lower? 
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Av.ijuxn* IVan rf x. •»!»««» ami l»ir<v)i.r »f Kc.-tkncr, MjiMurr»y College 

Wir t H I wai first confronted with the topic “The Social Life 
in a Church-Related College,*' my first reaction was a question- 
ing one, “Why is the problem of the social life in a church-re- 
lated college a unique question? In fact why is there any ques- 
tion? Are not all colleges interested in the social life of their 
students?" 

However, further reflection scented to indicate that possibly 
the very existence of the church related college might hinge on 
the solution to this problem. Does not this very relationship 
necessitate the highest standards the utmost effort to provide 
an envi moment where emphasis on the wholesome life can be at 
•a maximum? Must vve not exert every energy to attain the 
fundamental purposes of education? 

What is the purpose of education? Newman said as early as 
1852, “If a practical end must be assigned to a university course 
then 1 say it is training gixnl members of society, ” Or Sir 
Richard Livingstone of Oxford writes, “The most important 
task nf education is to bring home to the student the greatest 
of all problems the problem of living -and to give him guid- 
ance in it.” 

In other words, we must he striving toward the elimination 
of the type of college graduate who knows chemistry or physics 
or English but is not interested in the sociological problems in 
his community, who does not go to the polls on election day, 
who is too busy to be chairman of the neighborhood committee 
to secure adequate playgrounds. Our responsibility because of 
our church affiliations is to develop young men^ and young 
women who are thinking members of the community, who are 
unafraid to tackle community problems and who have high 
standards and the courage to support them. With all this we 
must recognise that in our rapidly changing world, education 
in adaptability and flexibility is equally vital. 

fil 4 
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It is within the realm of possibility that some of us might 
consider that we are accomplishing this main objective of educa- 
tion with an outstanding academic program. However, we must 
recognize that all experiences provided students are of the 
greatest importance because of the values which spring from 
such experiences. These values determine the student’s reaction 
to new situations, consequently it is essential that we supple- 
ment the academic program of our colleges by a well-rounded, 
comprehensive social program. 

In developing such a comprehensive social program we need 
consider only two major points: 1. What specific goals are we 
trying to attain? 1. How can we best attain them? 

Perhaps the most obvious specific objective would be to 
provide wholesome entertainment for the members of the stu- 
dent body at a reasonable expense. Second, to develop a social 
consciousness among the students. Third, to stimulate student 
leadership. Fourth, to create an interest in art, music and last- 
ing beauty. Fifth, to provide ample opportunity for spiritual 
growth. 

What features of our college community can we utilize to 
attain these goals? We will find many activities providing 
accomplishments in more than one of the above goals. 

The most vital force in student social life is Student Govern- 
ment. I quote from Ordway Tead, “I plead for the fullest pos- 
sible functioning of student government Here is provided active 
experience in human relations and group self-rule which, under 
wise guidance, has great character-building value.” An active 
student government can be a most vital force on any campus — 
an opportunity for much “laboratory experience in living.” 
Each of the specific goals is closely allied to such an active 
group. 

The student government can sponsor many of the social 
affairs on the campus Wise guidance from administration and 
faculty can aid in creating a varied program of dances (where 
the college permits), square dancing parties, sings, stage shows, 
carnivals, or parties of varied games. Students with a little 
ingenuity and assistance from certain college departments can 
arrange interesting and entertaining parties. Let us not over- 
look the help that can be secured in the area from our physical 
education departments. 
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Further, the *fudcnr government can sponsor small groups 
for the study of various campus problems. Such small groups 
give an opportunity to work to students who may not already 
hold jtmiriuns of leadership. These groups can do a great 
service to the students as well as to the college by carefully 
considering the specific questions that are their prerogative. 

Tile student government can create in all the students a 
sense of participating in a responsible government. Another 
positive benefit ol student government is the cultivation of a 
sentiment for honesty in examinations, and acceptable stand- 
ards of behavior in dormitories, fl’topia would be an honor 
system supported by every student, but that can only be ap- 
proached by ;t continuous cultivation of the honor sentiment.) 

We cannot rely entirely on student government for the at- 
tainment of all our goals. We must expect to assist by wise 
guidance in all phases of student government. 

Also, colleges need to be alert to the changing times by 
bringing thought provoking speakers to the campus and allow- 
ing discussion time following the formal address. There needs 
to be an opportunity for the stiulrnt to participate in this dis- 
cussion. (May 1 wish for your college the exhilarating experience 
of having a group of students request a further discussion with 
faculty following thes|x*ech of a visiting lecturer?) 

Can we not also use our own faculty members for special 
lectures or discussions outside the classroom? Campus clubs 
should Ik* encouraged to tap this source of program material. 

We must also provide an opportunity for interest in art and 
music. Informal sessions with recordings can be used to supple- 
ment opportunities to hear great artists. Expense should not 
deter our efforts to meet this need. Ingenuity of students and 
interested faculty can evoke great possibilities in informal gath- 
erings or special clubs. Jaet us not forget the recognition of the 
beauty in the sunset, or the starry sky, or the first snowfall. 
We must not fed that the only way to create an appreciation 
of beauty is to see or hear great masterpieces. 

And finally, although the very nature of our institution is 
the church affiliation, we must not overlook the need for in- 
dividual spiritual growth -for a sense of values and a relation- 
ship to something greater than oneself. Our responsibility here 
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is obvious — but not always easy of fulfillment. Chapel services 
are not always adequate. There needs to be available an under- 
standing person or persons who have achieved the sense of 
values and a recognition of the something-greater- than-them- 
selves who can assist our students to reach the same goals. 

With the main goal of education in mind and the. specific 
goals of the program before us, it behooves us to scrutinize 
carefully our existing social programs. At the risk of sounding 
cynical, may I say that no matter how adequate your social 
program seems to you I am certain there will be two strong 
sources of criticism. The students will complain that there is 
not enough to do, and the faculty will remonstrate that the 
social program is much too time consuming. 



ADMITTING YOUNG PEOPLE TO CHRISTIAN 
COLLEGER 


ft B M'»VT«nMtKY 

PidrfriH, t imJilwiTjt C*>UrSf« Virginia 

Tut colleges we represent and about which we are concerned 
must, it seems, trt me, l>e more than just “church-related.” They 
must be church collates, They must be an integral part of the 
< hurch. They must be Christian. It is our responsibility, shared 
with others, to make these colleges more inspiring, more ex- 
citing. more challenging and more Christian chan the church 
of which they are a part. By so doing, and only by so doing, 
can the church be renewed in vision, in faith, and in work under 
the enthusiastic and daring leadership of creative young people 
returning to it from the campus. 

To me, the Christian college means a pioneering school with 
its compelling purpose to inspire and to motivate the learning 
and living experience of young people toward becoming Chris- 
tian persons imbued with the challenging prospects of creating 
a Christian society of justice, righteousness and peace on earth. 
In other words, the Christian college is not interested or con- 
cerned, not in the least, with perpetuating the status-quo 
church, the status-quo state, or the status-quo anything else 
that is not fully Christian in character. The term “church- 
related college" connotes nothing particularly creative or chal- 
lenging to me. On the other hand, the designation of Christian 
college stirs the imagination to thrilling proportions with visions 
of great and continuing adventure under expanding horizons. 
We need to feet a distinct sense of pride and worth in being 
known as, and in being, Christian colleges. We need not be afraid 
of the designation provided we are willing seriously and sin- 
cerely to make the attempt to become effective Christian per- 
sona ourselves and are willing to take the lead in Christian 
living. The young people are never afraid, never ashamed and 
never unwilling to be Christian if they are fortunate to have as 
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their leaders administrators, teachers and counselors with the 
faith and the courage to pioneer. 

To be truly and sincerely Christian in purpose and program 
in our colleges is the one sure and certain way to be unique, 
distinctive and appealing. This approach to education offers 
to the administration, the faculty and the students a wide-open, 
limitless field for experimentation and exploration into the 
beckoning universe of newly discovered knowledge and truth. 
Moreover, it is a field that is not crowded and is free from strong 
competitors. However, a warning should be given that the 
Christian program in college education is not to be entered 
upon lightly by any one and not at all by the timid soul. There 
will be some people who will not understand and others who 
will understand but will not like a Christian program. These 
people may turn out to be, most likely will be, sitting in some 
seat of power in the community or in the church. But, if we 
dare intelligently and patiently and with forthright honesty 
and sincerity to be Christian, these who will be with us will be 
more in number and power than those who will be against us. 
In fact, multitudes around the earth are scanning the threaten- 
ing sky longingly in the desperate hope that such a coura- 
geous educational program will appear as the only saving force 
for our tragic times. 

The Christian college by its very nature and spirit will begin 
its program of learning and living with the function of admit- 
ting into its inspiring fellowship those young people who prom- 
ise to contribute most to the leadership of all of society in the 
direction of Christian progress. All useful vocations and profes- 
sions will be held in equal regard by the Christian college as 
noble and worthy channels for social and spiritual contributions 
to humanity. The Christian college will always be aware that 
it exists not for itself but for the young people who are its 
students or who may become its students. It will be reminding 
itself constantly that the college is made for the students and 
not the students for the college. It will not, therefore, be con- 
cerned with recruiting students just to enlarge enrollments and 
to collect fees. It will leave recruiting to the regimentation pro- 
gram of the Army, It will not be adjusting young people to this 
or that or the other. It will leave the adjusting of nuts to the 
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mamifa* Hirer of gadgets,. It will not be building character or 
pcTAonalm y. It will leave the building method to the engineers 
the brink masons and the carpenters who deal with inanimate 

things. 

The Christian college will be vitally concerned always with 
growing; persons who need a friendly, inspiring and challenging 
climate so which they can respond as growing physical organ- 
kin*. and spiritual beings to wisely provided intellectual nour- 
ishment and spiritual fellowship that guides them to a maturity 
of freedom and responsibility. 

The work of preparing and admitting young people to a 
Christian college in my judgment has some special considera- 
tions of a basic and fundamental character. The process and 
plan of procedure begins far back of the time when a young 
person graduates from high school or is faced with a college 
application blank. More than we have seemed to realize in the 
past, the problem mutually concerns the home, the church, 
the high school and the college ami demands their common un- 
derstanding and cooperation. We stand in constant danger of 
losing the soul of rhe young applicant along the assembly line 
of batteries of tests, inventories, forms, schedules, blanks, et 
cetera, or in the files of records and data afterwards as valuable 
and essential a* all these things unquestionably are in the pro- 
cedure. We are always in danger of neglecting to give the un- 
derstanding and sympathetic human touch of interest that 
encourages and create# faith in the student which often re- 
leases the spring of motivation, self-confidence and effort that 
results in Ids invalidating the normal predictions of his test 
scores. 

As Christian colleges we are under an obligation to remember, 
to understand and to believe in the power of faith operating 
upon life and in life to secure maximum achievement. Persons 
succeed in accomplishing worthy goals in life to a large de- 
gree because people have faith that they can achieve. We are 
strengthened in our efforts day by day by other peoples’ expecta- 
tions of us. I doubt if the tests we use make any fair allowance 
for this fact in human experience, but we must. This is not to 
claim that any person can overcome his lack of ability at any 
point but it is to claim that the understanding human touch 
can bring forth dormant or hidden potentialities. We may at 



ADMITTING YOUNG PEOPLE TO CHRISTIAN COLLEGES 6ll 


times be guilty of having more faith in test scores than we have 
in persons. I know of no test that even attempts to measure 
or to predict the spirit of a person or what his spirit will deter- 
mine to do when another expectant, sympathetic and stronger 
spirit becomes his ally. 

It is at this point that I wish to say that we of the Christian 
colleges owe to the church our opportunity in the particular 
educational work in which we are engaged Our particular col- 
leges were established and created in spirit by the church to 
be a definite part of its life and mission. We are under obliga- 
tion to give our maximum effort to the purpose of making 
society Christian, Tdiere is no hope that society will become 
Christian if the educated leaders that come out from our col- 
leges and go into the various vocations and professions are not 
seriously and courageously Christian. The great challenge of 
every Christian college, therefore, is to set high Christian stand- 
ards for academic achievement and in every other phase of 
its life and work and to admit Christian young people of ability 
and purpose who give promise under its inspiring guidance to 
dedicate themselves to the service and leadership of humanity. 
If we and our colleagues do not share deeply this desire and 
are not dedicated to this purpose we would do our colleges a 
distinct service, in my opinion, if we could resign forthwith. 

If this makes clear the kind of college we are and the type of 
college we expect young people to seek admission to, we may 
now discuss admission procedure or work. I have made no 
survey to find out how everybody is handling his admissions 
problem. I shall tell briefly, without filling in all the minute 
details, the direction in which we are working at the problem 
in the college I represent. We are always seeking, with an open 
mind, better ways to do our work. We have had and now have 
and, as far as I can see, expect to have anAdmissionsCommittee. 
This committee is now composed of the Dean of the College, 
the Dean of Students, the Associate Dean of Students, the Re- 
gistrar, the Admissions Counsellor, and the President of the 
College. This Committee reviews carefully every application 
which consists of a rather elaborate set of forms and votes to 
admit or to deny admission to each applicant. Insofar as is 
possible the Committee or several members of the Committee 
interview the applicants before their applications are considered 
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ftnn of the collate. We believe ir to be an excellent and essential 
service to render and begins the admission program to college 
at the time a young person starts in high school. It brings into 
understanding fellowship and cooperation the parents, the min- 
isters, the youth leaders of the church, the high-school coun- 
selor and the faculty of the college as they seek together to 
guide in a Christian manner and spirit the youth of the church, 

Admissions work, rtf course, is not completed until the new 
student w greeted and introduced in a friendly and helpful 
way into the life and work of the college. We have a week’s 
program carefully set up and carried out by the faculty and 
upperclassmen, and followed up afrcrwauls by an effective pro- 
gram of uuMKclling. 

This we feel is the kind of service a Christian college should 
render to the youth of the church of which it is a part and as 
fur as possible to all youth who seek admission to its campus 


It is my earnest hope and prayer that all our church or 


imposes upon them and by Christian methods 


l] 





STUDENT DISCIPLINE IN A COLLEGE 


C. GILBERT WRENN 

Professor of Educational Psychology, University of Minnesota 

No one can speak about discipline without making quite 
clear what he means by the word. In a discussion of this subject 
it should be clear that whereas the ordinary connotation of the 
word “ discipline” is that it means punishment of some sort, a 
restriction or an obligation placed upon a person because he 
has violated the mores or a law, there is another entirely dif- 
ferent meaning. By this meaning of the word, “discipline” 
signifies self-control A well-disciplined person is an individual 
who has thorough control of himself, who takes care of the 
situation within himself and without outer regulation. The 
actual evolution of the concept of discipline in colleges is that 
of moving from the first concept to the second. We are more 
concerned now than ever before with matters of self-control, 
self-decision, and self-determination in the lives of students. 
We realize now that many of the arrangements made for the 
so-called “welfare” of students have not contributed at all to 
the welfare of the growth of the individual. These arrangements 
have, on the other hand, been for the welfare of the group, or 
of the institution, or of society, but perhaps at the expense of 
the growing maturity of the individual 

Individual or Group f 

The welfare of the group or the growth of the individual? 
This is the great consideration in all matters of discipline. A 
little bulletin by Sheviakov and Redl 1 does perhaps the best 
job of anything in print of indicating this clash between indi- 
vidual welfare and group welfare. This bulletin, available and 
most useful for all who deal with students or young people, 
proposes “the law of marginal antisepsis.” This law consists of 

1 Sheviakov, George V. and Redl, Fritz Discipline /or Today’s Youth and Children. 
Washington, D, C.: National Education Association, 1944, 64 pp., 5 °?- 
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the proposition that one should go as far as possible in looking 
after the welfare, and growth of the individual without injuring 
the welfare and morale of the group. We go as close as wc can 
to forgetting the group in our concern for the individual, but 
we conic to a jniint where we must provide a kind of antisepsis 
for the group in protecting it against the behavior of the indi- 
vidual. A simple illustration is that of a group of youngsters 
taken by their teacher fur a boat ride. One of these lads, out 
of high spirits and a sense of freedom, moves around the boat 
rather recklessly although he is doing that which is perfectly 
normal for him and which is a healthy sign of behavior. After 
being cautioned a few times, he proves even more reckless and 
it becomes necessary to either completely subdue him or to run 
the risk of having the boatload of children overturned. The 
teacher in this case must "discipline” the boy for the protection 
of the group. The boy is squelched. He may even be forcibly 
held and this is in no sense gtaal for him or for any growth in 
self-responsibility, but it is essential for the welfare of the group. 

This concept, of course, has been overworked in most of our 
college situations. Most of us are more concerned with the group 
than we are with the individual. To put it another way, we are 
more concerned for the reputation of the institution than wc arc 
for the individual’s growth in self realisation and maturity. 
Yet, if we arc to put ourselves in line with the mosr humane 
and intelligent thinking in this area, we must shift in all of our 
concepts of discipline from the punitive to the learning empha- 
sis. 

In many colleges and universities now, discipline is handled 
almost entirely on a counseling basis. The person responsible 
for discipline considers that when a student has broken a regu- 
lation or the social mores and has come up for some kind of 
treatment the first thing to be done by the counselor is to 
discover why this happened. Such a diagnosis may indicate a 
cause that is in no way related to the immediate situation. 
Serious social frustration, family disappointment, a psychologi- 
cal trauma resulting from a general sense of personal injustice, 
or one specific instance involving hurt to the self-esteem of the 
individual may have sent the student overboard, so to speak, 
as far as social behavior is concerned. To further repress him 
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or to merely punish him for the social breach involved will in 
no sense meet the cause of the social misbehavior. Once the 
cause is determined, then the question arises as to what can be 
done to help the student learn from experience. The process has 
become a learning-and-remedial-treatment approach. The ex- 
perience may already have caused the student serious grief and 
concern, with perhaps a loss of self-confidence occurring from 
what someone has said, or from his own sense of guilt and 
shame. To further extend this loss of self-confidence will not 
benefit the student or the group. If the student, on the other 
hand, can learn from tire experience in such a way as to make it 
less likely that it will happen the second time, if he can learn 
through having tire focus placed upon the cause of the diffi- 
culty rather than the symptomatic behavior, then a good 
discipline situation has been demonstrated. 

‘three Principles 

The organization of discipline facilities on a campus under 
such a concept follows much the same principle regardless of 
the size of the institution. The counselor in any circumstance 
should nut have disciplinary authority over the individual whom 
he is attempting to help or he will risk losing his rapport and his 
effectiveness in the counseling relationship. For this reason, 
whoever acts as counselor should be able to appear before a 
disciplinary committee to give the facts of the case and to make 
a recommendation, hut he should not have a vote on the dis- 
ciplinary committee, If this is known to students, then their 
relationship to the counselor remains unspoiled. They will not 
have to put their best foot forward in the counseling situation 
by virtue of their knowledge that the counselor will have a vote 
on what happens to them. I have gone over this problem of 
discipline and discipline counseling on many campuses and in- 
variably find that if the same person who has authority over 
what happens to a student attempts to counsel with him, that 
neither the counselor nor the student feel that the situation was 
effective. 

A second general principle has already been suggested: 
namely, that no student regulation case comes before a disci- 
pline committee until it has been first screened through the 
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counseling process. This may mean that 75 to t/O per cent of 
the cases v. ill never have to conic before a committee. They 
arc handled t*n .1 le.»rnin«-and remedial-behavior situation that 
does not make it necessary to bring them up before a committee 
for action The counselor, of course, should be as well trained as 
possible in menial hygiene anti psychology in general for lie is 
in many cases dealing with deviations from normal behavior 
which are in n«* sense psy< hottc but which require considerable 
skill c« interpret , The relationship between the counselor and 
the student is of greatest importance. 1 firmly believe that if 
this relationship is sound, in many cases the student will be 
able to work out his own controlled behavior or self-discipline 
with a minimum of assistance from the counselor or anyone 
eke. Frequently what he needs is a chance and some under- 
standing upon the part of the college. This does not mean a 
soft policy at all, because the counselor and the student have 
both faced realistically the facts of the situation. 

Almost invariably the function of students versus faculty 
comes up in this matter of a consideration of discipline. Should 
students sit tin the discipline committees? Should they be there 
in greater proportion than the faculty or should students alone 
handle discipline problems? In general, the latter is not the best 
situation. Students arc frequently more severe and a little less 
tolerant of the intangibles in a situation than are faculty. On 
the other hand, students sometimes do a remarkably good job. 
You are hearing on this morning’s program from the President 
of Lynchburg College, where 1 happen to know a very unusual 
situation prevails as far as student-controlled discipline is con- 
cerned. It is one of the best places in the country to observe 
what happens when students are given a large amount of con- 
trol. In this situation there are four student bodies handling 
almost all problems of discipline. An Honor Council, the stu- 
dent body organization, and men’s and women’s student body 
governments handle problems of regulation violations and all 
other kinds of conduct problems in the dormitory or in the Col- 




groups has a faculty adviser, but the students indicate that the 
faculty advisor does not dominate but acts as a counselor of 
the body concerned. The Dean has a right to veto any of their 
decisions, but so far the Dean has not done so. There seems to 
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he a large amount of trust and confidence both on the part of 
the College in the students and of the students in the Dean of 
Students and the college administration generally. This is a 
fairly young situation. No one knows how far it will work, but 
under the circumstances that prevail at Lynchburg College I 
think it has an excellent chance. When I served there as a 
consultant only a month or two ago I went over this rather 
thoroughly with student groups and found the situation that I 
have described to you. This means that almost complete stu- 
dent control can work, but ordinarily it is the faculty-student 
combination that seems to be most effective. Perhaps the place 
where complete student control works most favorably is in 
dormitories, and here again the most favorable is the women’s 
dormitory. 

This whole matter of organization of counseling facilities is 
covered rattier thoroughly in a new volume by Williamson and 
Foley entitled Counseling and Discipline .* This volume comes 
out of several years of experience with the kind of discipline 
organization that I have beeij mentioning to you Of course, 
the University of Minnesota is a large university, but I am 
convinced that sound principles are advocated here which are 
not particularly dissimilar from those presented elsewhere, such 
as in Miner’s paper,* found in the Proceedings for last year. This 
paper stressed the point that discipline is a problem to be 
handled in terms of the effect upon the individual, but, at the 
same time, the group must be protected. In a sense this means 
that discipline is both an administrative problem and a coun- 
seling problem. It is a counseling problem insofar as the indi- 
vidual’s growth, his understanding of the causes back of his 
behavior, and the ultimate change in his individual behavior 
are concerned. It is an administration problem when the group 
or the institution must be protected from behavior which will 
affect its prestige or the morale of the total student body. As 
I have said before, this latter factor seems to take precedence, 
but it is only one of two parallel considerations and is probably 
actually secondary in nature. 


* Williamson, E. G. and Foley, John. Cou»s,lln S and Vhtifhm. McGraw-Hill 
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A Study of Discipline 

Perhaps I can make clear what I am speaking about in terms 
of discipline if I give you the results of a study made at the 
University of Minnesota by Miss Gladys Koepke, who for sev- 
veral years was a counselor of the sort 1 have been talking 
about in the Dean of Students Office there and who is now 
Counselor for Women at Drake University. Site studied the 
total number of disciplinary cases for the year 1947 4H. This 
involved 349 students, about I per cent of the student body. 
She found that about fi per cent of the total group were re- 
peaters, that sophomores were most frequent offenders with 35 
per cent of the total number of cases falling in that class, that 
veterans were slightly more represen ted than non-veterans. One 
or two interesting points were uncovered that may be suggestive 
to us aside from the bare statistics of the case. 

The 349 cases of students in difficulty were classified under 
the following rubrics: misconduct, which involved inter-personal 
relationships ami violations of housing or other regulations; 
disorderly conduct, which were more serious types of misbe- 
havior; financial irregularity; sex misconduct; theft; misuse of 
privilege; and a miscellaneous category. The women were con- 
siderably more prevalent in the misconduct category anti the 
men considerably more prevalent in the disorderly conduct 
category, and slightly more women than men were involved in 
financial irregularity. Slightly more men than women were in- 
volved in sex misconduct. The very considerable number of 
women misconduct cases is related to the fact that the majority 
of women involved in such discipline situations lived in dormi- 
tories, whereas the majority of men involved in discipline prob- 
lems lived at their homes or in rooming houses (about 63 per 
cent). Of course, this proportion of women under the miscon- 
duct classification may merely mean that they were living in 
women’s dormitories which had a considerable number of regu- 
lations. There is a direct relationship between the regulations 
on the campus and the number of cases called disciplinary cases. 
Tins is a function not of the students or their conduct as much 
as it is of the social structure in which they five and of the 
regulations provided by the college. 

Another interesting finding of this study is that whereas 
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there was a normal distribution of cases on A.C.E. Psychological 
Examination scores, there was a significant lowering of the Co- 
operative English "Test scores for those in the discipline category. 
Particularly in the case of the men there was a marked differ- 
ence between their English test scores and the test scores for 
men in general. This is true for almost every classification of 
offense- Thus it is suggested that there may be a language or 
semantic factor involved in the extent to which students abide 
by regulations. 


Church-Related Colleges and Discipline 

Now what is the relationship of all this discussion to church- 
related colleges? Is there any difference in church-related col- 
leges over other colleges as to the kinds of discipline problems 
faced or the way in which discipline treatment should be or- 


ganized? I doubt very much if there is any particular difference 
in the organization for appropriate handling of discipline. I do 
think that certain conditions prevail in church-related colleges 
which may affect the discipline situation as a whole. 

In the first place, I think a church-related college has a faculty 
and administrative staff in general which is more conscious of 
the significant and enduring values. This means they are a 
little more aware of behavior upon the part of the student which 
indicates deviation from the best and most worthwhile behav- 
ior. This has both its negative and positive values. It can be 
translated into a strict adherence to a pattern of behavior which 
the college sets up and which all students must follow, and this 
would be bad. It can, on the other hand, involve an awareness 
of the worthwhile values in life and encouragement of these 
values in the lives of all the students. When regulation or dis- 
cipline problems arise, such a college may be better able t an 
some other college to counsel in terms of most worthwhile 
things as far as values are concerned. , , 

In the second place, and this is a positive factor also, the 
church-related college is devoted to students as people. Each 
student has value regardless of background because there is a 
strong belief that all men have value in the eyes both of God and 
of men. This situation makes it easier to deal with individuals 
on a counseling basis than would be the case in an institution 



632 RW-CATIOKAJ. AND PSVCBOUH.lt AL MEASUREMENT 


where people were thought of as minds or where there was no 
particular concern for them as enduring personalities, 

Another possible characteristic of rhe church-related college, 
however, is not so favorable. I am convinced that in such col- 
leges we have a more flourishing abundance of regulations and 
a rather minute attention to the details of social behavior which 
results in mure discipline problems in the sense that the Koepke 
study brought out. This is particularly true of girls where we 
watch their behavinr with great exactitude. Parr of this, of 
course, flows from the constituency of the college and because 
families want careful watching of the students' lives. 1 think 
you can have a considerable number of regulations if the con- 
stituency seems to demand them, but I think at the same time 
there could be considerable latitude in the strictness with 
which these regulations arc observed. 1 also firmly believe 
that if there is to be a considerable amount of student respon- 
sibility for discipline that they must have a voice in the deter- 
mination of the regulations. 1 1 seems to me entirely unwarranted 
to ask students to administer regulations which they have 
had no voice in establishing. 

A fourth characteristic of church-related colleges might be 
described as a kind of paternalistic attitude toward students. 
This involves a desire upon our part to advise students too 
much, to hover over them with too much concern, and to ex- 
pect that they will learn vicariously through our experience. 
Students or young people in general do not learn too much 
from the experience of older individuals. In many cases they 
must see things for themsetves. This may involve behavior 
which we do not think is proper but which may be an excel- 
lent learning experience to them. Paternalism is a concept 
which is not particularly harmonious with growth and maturity 
upon the part of the individual, and this should be a major 
concern of all of us who deal with students. 

Finally, I think the church-related college may be more 
responsive to the pressure of social mores than are other in- 
stitutions. This is both good and bad. A certain amount of 
conformity is essential. Too much conformity is damaging to 
the individual and to his development. If we are too much 
impressed by right and wrong, meaning primarily that our 
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right and our wrong must be imposed on all with whom we 
come in contact, then we are damaging their development 
rather than assisting in it. I remember dealing with this sub- 
ject in a little bulletin called Building Self -Confidence* In the 
fourth chapter entitled “Determining What is Right” there is 
an attempt to help the high-school or college reader of this 
booklet to observe certain principles in the development of 
his own personal philosophy of life. One of these principles is 
that that which is right for you is not necessarily right for every 
one else. One of the surest ways of developing personal self- 
confidence and self-assurance is to have convictions by which 
you abide and which determine your own personal conduct. 
These convictions, however, must be your convictions and not 
necessarily those of anyone else. If you can apply this same 
reasoning to those of us who are college administrators and 
college teachers, we might have a more reasonable chance of 
impressing young people that we believe in honesty and right- 
ness but we also believe in the integrity of each individual per- 
sonality and the right which he has within himself to develop 
as a distinct personality. 

* V^rcnn, C, Gilbert. Bailing Stlj-Cwjidenct, Stanford Univ„ Stanford University 
Press, 1948, 32 pp. 



EXCHANGE PROGRAMS OF THE INSTITUTE 

ALICE A. ADANAL1AN 

Head, Division ot Specialized Personnel, Institute of International Education 

At the Council Day Luncheon, Mr. William Johnstone, of 
the Department of State, outlined the government program 
in the field of cultural exchange between the United States 
and other countries. He pointed to the difference between the 
program at present, as compared to the program of the pre-war 
period. This seemed to imply that this entire movement was 
a new one; however, we know that since the day of Alexander 
the Great there has been considerable activity in the area of 
cultural exchange. When Alexander visited the barbarian coun- 
tries which he had conquered with the intention of imposing 
the Greek culture on the vanquished, he discovered that the 
barbarians had a great deal of cultural development them- 
selves and that the Greeks could learn from them. As a result, 
he brought many young Greek men to the barbarian countries 
to absorb their culture. He also sent the brightest and most 
promising people from the barbarian countries to Greece to 
train them. 

Recently the Institute of International Education took a 
census of the foreign students who were in this country during 
the school year 1948-1949, which revealed that at present 
there are 26,700 foreign students studying in America, from 
1 5 1 different countries, in over 1000 educational institutions 
scattered throughout the 48 states. When we consider that on 
the average $2000 is necessary for a student’s maintenance 
for one year, we realize that this international educational ex- 
change program is quite a big business. Such an extensive 
program is made possible by the contribution of colleges, fra- 
ternities, sororities, men’s and women’s service clubs, bi-na- 
tional organizations and other non-governmental private ef- 
forts. 

The I.I.E. has been a pioneer in this field. Since its inception 
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in 1919, it has been stimulating interest and promoting the 
exchange of persons and programs of various types between 
the United States and the rest of the world. As you know, the 
Institute’s activities are well known in the educational field 
because it has administered fellowships for the past twenty 


years. 

Student Program . — The Institute has selection committees in 
each country which review applications from students who de- 
sire to study in the United States The applicants are selected 
on the basis of their background, their aptitude to pursue 
a profitable program of study in America, and their ability to 
interpret their educational and cultural attainments in the 
United States to their home country. When the applications of 
those selected by the committees are received by the I.I.E., the 
various divisions in the Student Service make contacts with 
educational institutions and many private organizations for 
scholarships and fellowships. 

After the arrival of the foreign student, the Institute con- 
ducts an orientation program where the student is given basic 
information about educational institutions, and the general 
way of life in the United States. During the entire period of the 
student’s stay in the United States, the Institute gives advice 
and assistance to the student in supervising his work, planning 
vacation entertainment, handling his insurance, financial and 


other emergency matters. . c 

News Bulletin .—' The I.I.E. publishes a monthly bulletin of 
news on programs and developments in the field of educational 
exchange at home and abroad. In addition to outlining infor- 
mation on new and old programs, the bulletin carries articles 
by prominent people in various fields such as Mark Starr, o 
the International Ladies Garment Workers Union Closed 
Minds are Dead Minds,” Mr. Edward W. Barrett, Editorial 

Director of Newsweek— “Enlightening the Enlighteners. The 

April issue was devoted to Unesco material in honor of the 
Second National Conference of the United States Commission 
for Unesco. Copies of this bulletin and the census Education 
for One World,” as well as other publications of the Institute, 
may be picked up from the table in the back of the room 
Information and Counseling Service.— The Institute has al- 
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ways been the central clearing home for information for edu- 
cational opportunities in this country and abroad. Many in- 
quiries made. With in person and by mail, are bandied by 
this division While some years ago the I.I.K. received about 
35,003 inquiries in one year, at present there arc weeks when 
wc receive approximately pieces of mail. This shows 

the accelerated interest in foreign study. 

P'ulMgkf P'elhwshtpi. Through the sale of surplus war ma- 
terial. considerable funds have Wen accumulated for use in 
education, under the Kulbright Bill. Since these funds are in 
foreign currency, it may be used in foreign countries or for 
transportation to and from the United States. These funds 
open educational opportunities for Americans who wish to 
study in countries which have Fulbright funds. Applications 
for such fellowships may he made through the Institute. 

Pro/esson and lecturers Division. The I.I.K. is well known 
in this field. For many years the Institute has brought special- 
ists in many fields to this country to lecture at educational in- 
stitutions and organizations from coast to coast. 

Recently a number of debating reams were invited from 
England. These teams traveled to universities throughout the 
United States and debated w ith American groujvt on subjects of 
economic or social significance. Some of the comments made 
by these debaters are quite significant and refreshing and indi- 
cate the real value in such experiences. For example, an Ox- 
ford team was quite impressed by the serious preparations by 
American teams in regard to the gathering of volumes of statis- 
tical and historical data, while they deplored their lack of humor 
in the presentation of their material. 

Division Of Specialized Personnel.- This newest section of 
the Institute was organized recently due to the increasing in- 
terest in bringing leaders and specialists from various countries 
to visit and learn the American “know how.” The program of 
this division is somewhat different from that of the Student 
Service. 

Usually the leaders and specialists are selected by each coun- 
try because of their outstanding work in one field. They are 
recognised leaders in that country, who are sent to the United 
States to learn the latest developments in America, in order 
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to assist in the reconstruction of their country. These persons 
are mature people and their program consists of consultation, 
observation, and visits to educational institutions, governmen- 
tal bureaus, industries, foundations, etc. Quite often their 
itinerary covers travel from coast to coast. 

In this division several specific projects are administered: 

United Nations Educational, Scientific and Cultural Organi- 
zation. — Sponsors Reconstruction Fellowships in six specific 
fields : Educational Administration, Social and Cultural Sciences, 
Art and Music Education, Cinema and Radio Education, Li- 
brarianship, and the Educational Problems of War-affected 
Children. One person from each of these fields is selected from 
the war-devastated countries The selection is made by the 
Ministry of Education of each country; however, the final award 
is made by Unesco. The program is planned and administered 
in this country by the Division of Specialized Personnel of the 
Institute. Unesco has prepared a handbook on international 
fellowships which outlines opportunities in many countries as 
well as in the United States. 

American Chemical Society. — Funds are raised by the group 
for specialists in various phases of the field of Chemistry. Se- 
lection of the Fellows is made by Unesco while their program 
is planned, administered and supervised by the I.I.E. 

‘The Belgian Institute for the Encouragement of Scientific Re- 
search in Industry and Agriculture.- — Sends Fellows to this coun- 
try to learn the latest developments in their field. These per- 
sons usually stay a period of three to six months and return to 
their country either to the educational institution or to an in- 
dustrial concern from which they came. Most of the persons 
financed by this society are specialists in the fields of Chemistry, 
Engineering, Metallurgy, Physics, and Agriculture. 

Atlantique. — Is the French-American Society which brings 
social workers to the United States to get practical training in 
cooperation with social work agencies in the United States. 

American Association of Collegiate Registrars Has made a 
grant to a registrar from a war-devastated country to observe 
and study administrative and registration procedures in Amer- 
ican universities. 

Institute of Inter-American Affairs. Brings educators in vo- 
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rational, cdu* atiuna!. and technical fields from T.atin American 
emtn tries t* 1 the United States for observation of American 
methods r, f education in urban and rural communities. 

'Die importance of international cooperation has been recog- 
nized by the: National Y<h .Omml (hiid.mce Association and 
the z\rnerican College Personnel Awwiarinn since they both 
apjKijnrcd a special committee to develop programs in this 
area These committees had a joint meeting on Tuesday even- 
ing and specific projects of cooperation were outlined. The 
Chairman of the meeting v>dl present the proposed program 
later. 

1 would like to make a few specific suggestions of ways in 
which counselors, personnel workers, and deans in universities 
may be of assistance in this ex< hangc of persons program: 

i. They could aid the foreign student', in adjusting to study 
mcfh*td» and in general university life, make contacts for 
them in the community so that the students may learn by 
participation in the American communal life, interpret for 
chcan the differences in American culture and their own 
culture, and assist them m Imam jat matters, if necessary. 

i. They could assist American students wishing to study 
abroad by' giving them information about opjMirtunitics, 
and informing them of proper agencies to contact in plan- 
ning such a study trip, ’t hey might give them data on Kul- 
hright opportunities, student tours, and summer study 
possibilities. Orientation programs may be conducted for 
American students going abroad, giving them information 
on the cultural Inu kgroutui of the countries in which they 
will visit, as well as making them conscious of the fact 
that each foreign student is an ambassador of the United 
States, and, therefore, must realize his responsibility for 
interpreting the American way of life and ideals to the 
-countries he may visit. 

3. They could collect and contribute hooks, tests, forms ami 
other materials for the purpose of sending them to deans, 
counselors and personnel workers in other countries to as- 
sist them in organizing and developing guidance programs. 

In conclusion I would like to point out that deans and the 
guidance and personnel staff of colleges in their roles as eoun- 
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selors have a real responsibility and a unique opportunity to 
make it possible for foreign students to really experience and 
comprehend the American thought and way of life. Let us 
strive to develop international activities in the N.V.G.A. and 
A.C.P.A. so that we may contribute an important link in the 
world-wide chain of understanding upon which lasting peace 
must depend. 



VOLUNTARY EXCHANGES WITH THE OCCUPIED 
AREAS WHY AND HOW? 

mm-t.ji i ; ssrni-R 

Ihfjftlt 1 *, Ctyw* *%*,?*» rrs? ffcrwfNCjJ Vjr«.% Atnstu.xn on EdiKAliort 

At your past two convention* I have hern privileged to 
speak concerning the UNESCO TIER program for educational 
reconstruction in the war-devastated countries. I am pleased 
to he aide to report that our final survey of the efforts of 
American voluntary agencies slums that, since 1946, aid total- 
ling $2?4 .oov>,o has been given by approximately 400 organ- 
izations This represents the work of millions of school children, 
college students, professors and other professional workers, 
farmers, member* of churches, lalxir unions, and clubs of all 
lyj-Krs. tty wilding Iwoks and other educational materials, offer- 
ing fellowships and study grants, sending educational advisory 
mission's ami organizing work camps, they have played an 
important parr in building world understanding. 

It is gratifying to note that among the organizations now 
reporting worthwhile projects is the National Vocational Guid- 
ance Association which has collected and sene abroad thousands 
of books, pamphlets, and tests. As you are aware, this effort 
which came to ft head during the past year represents a long 
period of careful preparation. It should result in great satis- 
faction and in lasting contacts with professional workers and 
with major educational institutions and organizations in other 
countries. American experience in the fields of guidance and 
counseling ranks high among the priority interests of nations 
struggling to modernize and strengthen their systems of edu- 
cation. This gesture by your Association will meet a real need. 
It will also constitute an important new link in the world-wide 
chain of understanding upon which lasting peace must depend 
for support. May I, therefore, on behalf of Cl ER and UNESCO, 
express my thanks and also my congratulations to the American 
College Personnel Association which is developing several in- 
ternational projects? 
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CIER is discontinuing its separate existence this spring 
While the job is far from completed, it was felt to be timely 
to turn over direct responsibility for leading the United States 
effort relating to this important part of the UNESCO program 
to the United States National Commission for UNESCO which 
had not yet been formed when CIER was organized in 1946 
Your association is urged to cooperate with the National 
UNESCO Commission as you have with CIER 

Gratifying as the response has been, much remains to be 
done. Any voluntary effort necessarily leaves major gaps and 
neglected aspects. The countries under military occupation 
have received only about 5 per cent of the total contributed 
by American voluntary organizations for educational recon- 
struction. This is far less than the extent of their devastation, 
the magnitude of their problems and the nature of our national 
responsibility would justify. 

When I first spoke to you two years ago, it was still not 
possible for American organizations to send personnel, books, 
or other educational materials to German universities, schools, 
and libraries. Bringing Germans to the United States for study 
was then only beginning to be considered as a possibility for 
the rather distant future. CIER’s r 61 e in relation to the occu- 
pied countries became, therefore, at the outset largely one of 
urging — and, at times, even prodding to bring about the 
prompt opening of channels of communication between Ameri- 
can education and educational agencies in those countries. 

This goal has now been largely achieved, only partly through 
the efforts of CIER alone, and largely as a result of the in- 
creased understanding by our occupation authorities and our 
government agencies of the importance of education in the 
development of democratic institutions. Exchanges of person- 
nel goods, and services between the three Western Zones of 
Germany and the United States and with Austria, Japan, 
and Korea are now possible, subject, of course, to the limita- 
tions of necessary security controls and the extreme economic 
disadvantages under which these peoples still find themselves, 
Remaining obstacles are rapidly being eliminated It is now 
possible to say that individuals and institutions in this country 
desiring cultural exchanges with the four occupied countries 
and willing to take the initiative to find financial means and 
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flu* personnel to bring about such cunt act, can have such rela- 
tions. 

People in the mwupjrd countries are, of course, still severely 
handicapped in their ability m take the initiative in bringing 
about such rv hangex. The recently improved status nf our 
education offices in Germany and .Austria and the earmarking 
nf substantial cmrrnmrnt funds for the promotion of exchanges 
of personnel between «mf <<»«mtsicft arc examples of the increas- 
ingly enlightened way in which our military government is 
discharging its occupation responsibilities. 

i'.iittcatiorta! reconstruction in the occupied countries is an 
extremely delicate and complex process. In Germany and Japan 
the problem is one of reorientation and re ’education, of over- 
coming the effects of years of training in blind obedience to the 
nders of a totalitarian state This process of re-education goes 
forward under unbelievably difficult conditions in Germany 
where the country is divided into four distinct political units, 
torn by ideological conflicts, crushed both physically and 
morally. 

The occupied countries are. to a considerable degree, the 
official responsibility of the t’nited States. The world, therefore, 
views with intense interest and sometimes considerable con- 
cent what happens there. Our national objectives, our con- 
ception of democracy, the efficiency of our methods, our in- 
tegrity, will be judged largely by what wc do in the occupied 
countries and how we accomplish it. Our military government 
in the* countries recognizes that it. as an occupation force, 
is extremely limited in what it can do or could do even with 
larger government appropriations toward educational and cul- 
tural rehabilitation. 

The educational system uf a country is so sensitively and 
integrally a part of the fabric of the national culture that 
reforms imposed from without are likely to meet with extreme 
resistance. Lasting changes must he brought about from within; 
to stimulate and encourage this process requires the utmost 
tact and understanding. It is jtossible to help along the process 
of cultural rehabilitation and of democratization by offering 
services known to be troth needed and desired, such as exchanges 
of personnel and materials. 
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Here American colleges and voluntary organizations have 
certain advantages over our official governmental agencies 
They can begin to establish direct cultural links with similar 
institutions and groups in the occupied countries without in- 
curring the suspicion that such effort may have a political 
motivation. Through friendly acts of good will, they can help 
to create a spirit of cooperation, of mutual interdependence, 
conducive to the restoration of self-respect and the desire for 
self-help. By encouraging the best qualified of their faculty 
members and college administrators to undertake teaching, 
advisory, and administrative responsibilities in the occupied 
countries, they can help to give these areas the benefit of 
American technical and professional developments bearing upon 
problems of reconstruction and reorientation 

To accelerate the process of cultural interchange, the Ameri- 
can Council on Education, at the request of General Clay 
and other government officials, established the Advisory Com- 
mittee on Cultural and Educational Relations with the 
Occupied Countries (the name has recently been changed to 
the Commission on Occupied Areas), under the chairmanship 
of President Herman B. Wells of Indiana University As its 
name indicates, the Committee serves in an advisory capacity 
both to official and to voluntary agencies. It endeavors to 
stimulate an interest on the part of organizations and institu- 
tions in playing a greater part ill the cultural rehabilitation of 
the occupied countries and in the development of lasting co- 
operative relations between groups here and those in Germany 
and the other countries. It will assist in locating qualified 
personnel to undertake major professional assignments abroad 

To carry out its functions, the Committee has established 
a series of panels or commissions to act for it in the special 
fields requiring particular attention in the occupied countries 
These panels are, in almost every case, sponsored by an es- 
tablished, permanent organization — usually a coordinating ot 
research council of the principal organization in each Field. 

Materials describing the objectives and scope of the Ad- 
visory Committee are available by writing to the Committee, 
at 744 Jackson Place, N.W., Washington 6, D.C Your inter- 
est, advice, and cooperation is earnestly invited. Special atten- 
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tion is directed l n the provision of fellowships, scholarships, 
and study grants for graduate and undergraduate students 
from the occupied countries Generous provision has been made 
from United States Military Government funds for the pay- 
ment of transportation of such students. Other costs must 
generally be made from voluntary sources. The Institute of 
International Education administers this program and can sup- 
ply full particulars Since Miss Adana! ion of the Institute 
is ako on this program, I will leave to her a!! reference to 
other voluntary exchanges of personnel 

Other specific ways in which colleges and organizations can 
aid in the cultural rehabilitation of the occupied countries 
follow. Professional and technical hooks and periodicals -even 
in the English language arc urgently needed. Used items in 
good condition, including certain types of textbooks, are wel- 
come. Those interested tn sending books and periodicals may 
secure detailed information concerning what to send, and where 
and how to send them by writing to the If. S. Rook Exchange, 
Library of Congress, Washington 2<, 1 ).C. This agency is the 
successor to the American Honk Center which has forwarded 
more than one and one half million items since 1946. 

A new (took aid program of great importance lias just been 
launched by CAKE. Under this plan libraries, both public and 
institutional, in many parrs of the world, will make their 
needs known to CARK. American contributors can purchase 
through CAKE the needed new bonks at greatly reduced rates 
and will he notified which books have been purchased anti their 
names. Detailed information can be secured from CARE, 50 
Broad Street, New York City. 

Educational advisory missions, such as the medical and den- 
tal teaching missions of the Unitarian Service Committee, are 
another extremely useful form of service. 

Educational work camps, of the type conducted by the 
American Friends Service Committee, provide not only val- 
uable service, but afford an opportunity for development of 
international understanding on the part of participating 
students. Full information concerning such projects can be 
secured from the Interdenominational Commission on Youth 
Service Projects, 303 North Wabash Street, Chicago, or from 
the National Student Association. 
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One of the most important channels for student effort is 
the World Student Service Fund, 20 West 40th Street, New 
York 18, N. Y. This agency will be glad to recommend special 
projects on behalf of students and faculty members of institu- 
tions in the occupied countries. 

Finally, some of you may recall that on Council Day two 
years ago in Columbus, I proposed that the graduating classes 
of schools and colleges memorialize themselves by making such 
contributions toward the educational reconstruction of schools 
in devastated countries. More than 300 schools and colleges 
have responded to this appeal and have received certificates 
for framing showing that they have been willing to make a 
small sacrifice to aid those less fortunate than themselves in 
lands which have suffered the ravages of war. I have received 
very few complaints from school principals that they missed 
the usual class gift of a painting, a statue, or a plaque which 
departing seniors have in the past left to clutter up the halls. 
On the contrary, many have taken great pride in their ability 
to point to concrete evidence of the world-mindedness of their 
students. 

The Graduating Class Memorial Project is continuing this 
year. Those of you who are class advisors are urged to draw 
this possibility to the attention of your students. These special 
funds may be contributed either direct to the UNESCO Re- 
construction Fund or to any responsible American operating 
agency engaged in educational reconstruction abroad. 

I have tried to provide reasonably brief answers to the 
questions “Why exchanges with the occupied countries?” and 
“How can voluntary action be made effective?” I hope that 
I have convinced you that the opportunity for service is un- 
limited. I know that we can depend upon the continued interest 
and support of your two associations. 
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A COMPARISON BETWEEN PERFORMANCE ON A 
SENTENCE COMPLETION TEST AND 
ACADEMIC SUCCESS 1 

JOHN M. HADLEY and VERA E KENNEDY 
Purdue University 

Introduction 

Sentence completion tests used as projective techniques 
require careful and time-consuming interpretation For use as 
predictive or selective devices with any substantial number of 
subjects, the time and effort required are prohibitive. The 
first specific purpose of this study was to evaluate a method of 
scoring which might be useful for predictive purposes A second 
purpose was to investigate the relationship between conflict 
as measured by the sentence completion test and academic 
achievement. The hypothesis to be tested was that conflict, 
as measured by the sentence completion test, would be signi- 
ficantly different in two groups of persons of equal ability, but 
with markedly divergent scholastic achievement. 

A review of the literature concerned with sentence completion 
tests as projective techniques reveals that until recently rela- 
tively little research has been done. Although this type of test 
was devised to study mental capacity and reasoning ability 
by Ebbinghaus in Breslau in 1897 (5) and introduced into this 
country by Traube (25) and Kelley (8) in the early part of the 
twentieth century for the same purpose, the first use of the test 
as a projective technique in personality study is credited to 
Payne in 1928 (14). 

Rohde (17) reports that Payne assembled a test to be used 
on college students with the intention of eliciting inhibited 
responses, and that his test was subsequently rather widely 
used in vocational counseling, An article by Tendler in 1930 

1 This represents the main content of a thesis submitted by the junior author in 
partial fulfilment of the requirements for the Master of Science Degree in Psychology 
at Purdue University. 
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(?_]) suggests a vrr-inn of a *cj»cnrr completion test called a 
Test vf hmoUonal hui?,ot, w hii h mhdit he used to discriminate 
emotional from thought processes or to arouse direct, free, non- 
choice responses. He rondu< tr i nn experiment on a group of 
subjects of comparable intellectual ability to validate his test 
against autobiographic sketches and the H'onJunrth Personal 
Data /Hank. 

In the decade follow ing Trndlcr, lit tie interest was manifested 
in this sort of projective den ice until 1940, when another test 
was wmpnril from I 'ay tie’s original sentences by Hildreth and 
Rohde of the Lincoln .School of Teachers College at Columbia 
University fid)- din* greater part of sentence completion tests 
have evolved from this revision in modified form with various 
types of sentence strut tores of lrs«cr or greater complexity. 
Hildreth anil Rohde validated their measure, judged in terms 
of the Murray ft 2) schemata of personality organization and 
quantitatively expressed as frequency and intensity, against 
ratings and judgments of teachers, parents and counselors. 
They found correlations, all categories of opinion being com- 
bined, of ,79 for girls and ft; for boys. The agreement between 
five scorers of the test was 78 per cent. A consistency of .82 
for girls and .76 for brsys was found to exist after a period of 
eight month*. 

The war period created a need for person net screening de- 
vices, anti special arid unusual military assignments led to a 
wider utilization tif clink ai diagnostic aids, among which the 
sentence completion test was included. Joel Shor (20) of the 
City College of New York, calling his form of the test the Self- 
Idea Completion Test, used it in approximately 1800 clinical 
personality studies in five military installations and found it a 
valuable aid in the interpretation of “personality dynamics for 
diagnostic and prognostic purposes.” Holzbcrg (7) came to 
similar conclusions, but he, too, docs not present any quanti- 
tative demonstrations of his deductions, Large and Thorndyke 
(10) introduced single-word responses in order to facilitate 
objective scoring, but were able to report little relation between 
answers and actual behavioral patterns of the subjects tested. 
Rohde (tfi) implies that the technique employed by these 
workers was too limited and specific for freedom of response. 
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Stein (21), of the Veterans Administration, thought that the 
sentence completion test was a valuable supplement to other 
projective devices and particularly useful in a clinical way, 
since it required less specific training either to administer or to 
interpret. Furthermore, the test, being more structured, yielded 
more material with unimaginative patients than did the the- 
matic Apperception test or the Rorschach. Rotter and Willer- 
man (i 8), using an adaptation of a test devised by Cameron 
(3) to study schizophrenic thinking, utilized the test in the 
Army Air Forces convalescent hospitals to assist in evaluating 
psychological fitness for return to duty. A means of scoring it 
in terms of the degree of conflict revealed in the responses was 
devised. Theirs is essentially the method of conflict determina- 


tion that has been employed in the present study. 

The test used in this study is the one developed under the 
guidance of Murray and MacKinnon (13) in the Office of 
Strategic Services Assessment Program to provide interviewers 
with mateiial for analysis of the personalities of the candidates. 
It has been quoted by Stein (21) and Symonds (22). The test 
was so satisfactory for the purposes of the Office of Strategic 
Services that it has been adopted for use in the Veterans Ad- 
ministration Rehabilitation programs and may be thought, 
therefore, to have some general applicability. The test was as- 
sumed to allow the expression of unconscious trends that would 
normally have been hidden in the “reaction formation” of the 
personality of the individual, and the results were said to refer 
to “fantasies or unconscious impulses” which might not have 
any counterpart in “behavior and attitudes of real life, btill, 
Svmonds (22) feels that the test cannot be used as yet in pre- 
diction of personality disorders and states “From this study, 
it was noted that as far as the Office of Strategic Services 
record goes, the high and low groups were sharply differentiated 
for each characteristic. But there was no discernible trend f 
the same characteristics as taken from the sentence completi 


The prediction of academic success from scores on intelli- 
gence tests, achievement tests, high-school grades and 
femester college marks, as Cole (4) points out, has not shown 
as marked a degree of accuracy for those students at t e upper 
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end of the distribution as they have for those students falling 
at the lower end. As a matter of fact, she reports that within 
the past ten years our ability to predict has declined in ac- 
curacy, due perhaps to more adequate vocational counseling 
in high school and the encouragement of students to enter 
fields commensurate with their ability, thus diverting many 
of the poorer students (upon whom the prediction in great part 
depends) from colleges. Consequently it may be assumed that 
the failure to predict achievement at the upper part of the dis- 
tribution may indicate that intelligence tests alone are inade- 
quate in uncovering those very important factors which arc 
related to scholastic success and which may prevent students 
from achieving work within the range of their ability. 

Although in general the correlation between scores obtained 
on such a test of ability as the A.C.K. (American Council on 
Education Psychological Examination) and academic success 
is approximately /*0 {15), Leighton at Oregon (9) and Bell 
at Purdue ftt) have shown that there is a less-than-to-be-ex- 
pected difference between the performance of students at lower 
positions on the intelligence, continuum and students at the 
upper position. 

Several workers have attempted to establish a relationship 
between nun-intellective factors and academic achievement. 
McCandlesa (11) gave individually administered Rorschach 
test® to two groups of highly superior men matched on the 
basis of the Cfeneral Classification test score, age, education, 
mechanical comprehension, reading comprehension and mathe- 
matics. The first group had grades of straight A; the second 
averaged low C'b and D's. There were no significant differences, 
although some differences were suggested. Thompson (14) ad- 
ministered the group Rorschach to ia8 students of general 
psychology and analyzed the data in terms of semester grades 
and verbal aptitude test scores. By the selection of several 
factors which gave low correlation with the aptitude test and 
higher correlation with grades and combining these factors 
with the aptitude test, the resultant multiple correlation with 
grades was .74. The aptitude test correlated .66 with grades. 
Therefore it was felt that the nan-intellective Rorschach factors 
might be considered as a partial index to motivation, Akus (1) 
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combined an adjustment test and a study habit inventory with 
a verbal aptitude test and secured a multiple coefficient of 
correlation of .76, compared with a coefficient of .60 when the 
aptitude test was used alone. Scott (19) found that the corre- 
lation between tests and marks rose to .74 with the addition of 
data from personality ratings and tests. 

The sentence completion test has been used here in an 
attempt to get at some possible factor among those that might 
distort predictive devices and to note whether or not such a 
factor, judged in terms of clinical recognition of conflict, might 
discriminate students of the same level of ability who do achieve 
predicted scholastic levels from those who do not. 

Procedure 

The subjects considered in this study were 157 students out 
of 54° enrolled in an introductory course in psychology at 
Purdue University in the spring term of the academic year, 
1947-1948. All of the 540 students were given the Sentence 
Completion ST est-, however, of the original total, only those 
falling at the sixtieth percentile rank or above on the A.C.E. 
{American Council of Education Psychological Examination) 
were utilized for analysis. 

The experimental group was divided into a group of high 
achievers and a group of low achievers on the basis of their 
cumulative grade-point indices. The division between the groups 
was determined by making a frequency distribution of the 
cumulative grade-point indices of the entire group of 540 stu- 
dents, which covered a range from 2.05 to 6.00, and selecting 
from the whole sample those students who stood at the sixtieth 
percentile and above and those who stood at the fortieth per- 
centile and below. Those students with an A. C. E. test 
percentile rank of 60 or above and whose grade-point indices 
fell at or above the sixtieth percentile were designated as the 
high-achieving group, and those whose test percentile rank was 
60 and above but whose grade-point indices fell at or below the 
fortieth percentile were designated as the low-achieving group. 
The students were distributed among the various schools of the 
University according to the following order: Engineering 54; 
Science 35 ; Liberal Science 26 ; Home Economics 13 ; Agriculture 
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1 1 ; Pharmacy ft; Trade ami Industrial Education 5; Special 
Students 4; am! t'hy«.i<al 1 -dm at; >n 3. The .students ranged 
from the first to the eighth semester and were distributed among 
the terms in the follow mg order- hirst <r ; second 54; third 19; 
fourth 54; fifth ti*. sixth J2, seventh S; and eighth 4. There 
were 49 girls and to* boys m the total group. 

It is interesting to note that when the mean intelligence 
scores fur the two criterion groups, who were divided only on 
the basis of their as hievementx. were calculated, that a differ- 
ence! did exist. The mean intelligence percentile rank for the 
high achievers was. ST 45 and that of the low achievers was 
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74.6a, The mean percentile rank on the Purdue Pest for English 
Aptitude was Ko.co and 58.96 respectively (tee Table 1). The 
average grade point index fur the high-achieving group was 
4. S3, whereas that of the low group was 3.41. The difference 
between percentile ranks that docs appear in the given direction 
would be expected if, as previously stated, a correlation of 
approximately .60 does exist between grade-point indices and 
intelligence. According to the regression phenomenon, if two 
measures that arc rectilinearly related are studied in a group 
of persons selected on the basis of one trait, the mean value of 
the second trait will regress toward the general mean of that 
trait in a whole population. It would be expected, therefore, 
that the low achievers would as a group average somewhat 
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lower on intelligence scores than the high achievers. On the 
basis of the above descriptions it was assumed that the subjects 
were not an atypical group for an experiment that would, in 
effect, be testing for the presence of another personality ele- 
ment, namely, some emotionally toned factor. However, in 
view of the fact that differences did exist between the criterion 
groups on the A, C. E., the English Placement 'Pest and on 
other factors such as sex, term in school and major interest, 
further groupings were made in which the high and low achiev- 
ing groups were matched on all possible factors. 

The sentence completion test used in the study was Parti of 
the test constructed under the direction of Murray and Mac- 
Kinnon (12.). Each part of the test, as designed by these 
workers, consisted of 50 incomplete sentences written with an 
eye to stimulating responses in the following areas, as outlined 
by Stein (21)' 

(1) Family: Attitude toward the family unit and toward each 
parent. 

(а) Past: Attitude toward the past, reactions to previous 
frustrations and failures and effects of past experiences 
on present behavior. 

(3) Drives: The primary motivating factors in the given 
. personality. 

(4) Inner States: The feeling experienced most frequently and 
the nature of the situations arousing such feelings. 

(e) Goals: The ends toward which the person is striving. 

(б) Cathexes: Objects, activities or ideas desired and for which 
the subject is willing to make sacrifices. 

(7) Energy: Energy level and how this energy level was 
affected by stress and frustration. 

(8) Time Perspective: Attitude toward past, present and 

(9) Reactions to Others: Attitudes toward inferiors, equals 

and superiors. . . , , 

(10) Reactions of Others to Subject: Impression of how others 

feel toward subject. 


The actual sentences selected, Stein (21) reports, for the form 
of the test used in this study, were those that had been dis- 
tinguished as having a high degree of individuality as contrasted 
with stereotypy from responses to incomplete sentences whic 
had been studied in a pilot work on 25 records Those items that 
were stereotyped in response were eliminated and other items 
were added to cover areas that were thought to have been 
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inadequately covered in the first version from which the present 
one was derived. Another index was determined on 40 records 
of the last form of the test, and it was found that there was 
still a high degree of individuality for the added items. The 
final 100 items of the test were of two types in general: First, 
incomplete sentences in which names of persons appeared and 
thereby suggesting that the subject might react to various 
situations as though he were another person and unaware of 
revealing his personal attitude; and second, incomplete 
sentences of a more personal type or of items containing the 
pronoun “I”, and hence calling for responses with no attempt 
to disguise the purpose of the test. 

The test of one hundred items was administered in two sec- 
tions to avoid monotony and fatigue. However, only those 
fifty items of Part I answered by the high- and low-achieving 
groups were scored and analyzed for this study. 

The responses were scored according to the method of Rotter 
and Willerman (18) but modified for the present study by 
differentiating responses into only three categories: conflictual, 
neutral and positive, rather than into three degrees of con- 
flictual and positive areas. Conflict, positive or neutral re- 
sponses were determined on the basis of clinical judgment, 
which included suggestions offered by Rotter and Willerman. 
These authors say that conflict might show itself in various 
forms, and in order to avoid undue complication in scoring, 
they grouped responses indicating hostility, recall of unpleasant 
past experiences and symptom elicitations as examples of con- 
flict. Similarly, humorous, optimistic and acceptance responses 
were considered as positive adjustment, whereas neutral respon- 
ses were those that did not manifest a marked trend in either 
direction. Facetious answers, omissions and avoidances were 
considered as neutral since these investigators did not find a 
greater incidence in the more maladjusted subjects as judged 
by other clinical data. The number of negative or conflictual 
responses was subtracted from the number of positive responses 
and divided by the total number of items attempted. The scores 
thus obtained were considered as whole numbers by moving the 
decimal place. If responses to intermittent items were omitted, 
they were, according to the above scoring, considered attempted 
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and neutral, but all items after the last attempted response 
were not computed into the total number of responses when 
omitted A negative score, following this scoring method, would 
indicate a predominance of conflict-scored responses. In an 
article appearing after this study was completed Hardy (6) 
describes the use of the same test scored in essentially the 
same manner, but used to evaluate dominance or aggressive- 
ness. She gives no data on reliability of scoring. 

In order to ascertain the reliability of scoring the Sentence 
Completion ‘Test as a measure of conflict, 25 tests were discussed 
by the experimenters so that a standard method of scoring 
could be agreed upon to the extent that such an agreement is 
feasible. One hundred tests were then scored separately by the 
experimenters. A Pearson product-moment coefficient of corre- 
lation was computed between the total conflict scores on 100 
tests as judged by the two scorers. A further investigation into 
individual items was undertaken in order to determine those 
items upon which the two scorers showed marked agreement. 
For each of the 50 items on 100 tests the per cent of agreement 
between the two scorers was computed for each of the scoring 
combinations. Those items upon which there was found to be 
little agreement and those upon which there was found to be 
considerable agreement were then singled out. The items that 
showed the greatest amount of agreement between the scorers 
were then compared with the items that were found to differ- 
entiate between the two criterion groups in an effort to deter- 
mine whether or not individuals scoring such a test could agree 
on making the items that apparently measured most clearly 
the trait in question. 

In an attempt to obtain a measure of self-reliability, or of 
one scorer’s consistency in scoring, the junior experimenter 
re-scored the 100 tests after a period of one week, and a co- 
efficient of correlation was computed between the first and 
second scorings. 

On the basis of the observation that certain items in the test 
were consistently scored in one direction or the other, due to 
the nature of the sentence stem presented, an analysis of the 
responses to specific stems was made, and certain items were 
noted which were for the most part answered in the same way. 
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With a view to eliminating those items that for various reasons 
did not differentiate between the two groups, the significance of 
differences between the percentages of each group answering 
each item as conflict, positive or neutral was computed. Those 
items that resulted in a critical ratio derived from the differences 
between the criterion groups, significant at the io per cent 
level of confidence, were regarded in this study as being those 
that discriminated between the assumed conflict and the non- 
conflict groups. 

In spite of the fact that it would be almost impossible to 
obtain equivalent forms of a sentence completion test, because 
of the partially unstructured nature of the items composing it, 
an odd-even split correlation was done in an attempt to evalu- 
ate the internal consistency or reliability of the test. The tests 
of loo subjects who had completed all of the fifty items were 
selected for this investigation. Total conflict scores for the ioo 
subjects were computed for the odd items and on the even 
items. A correlation between the individual’s total conflict 
scores on the odd and on the even items was calculated. The 
Spearman-Brown Prophecy Formula was used to arrive at a 
reliability coefficient for the entire test. 

To test the second hypothesis of this study, that is, that 
individuals who score high on intelligence tests and do rela- 
tively poorly as measured by their course grades are individuals 
that show more conflict than those persons whose academic 
achievement is commensurate with their intellectual ability, 
the significance of the difference between the mean conflict 
scores for the high- and the low-achieving groups was deter- 
mined. It was felt that if a true difference did exist and if the 
sentence completion test does measure emotional factors, one 
could say with a reasonable degree of confidence that emotional 
factors are in part responsible for the discrepancy found so 
often between academic performance and academic capacity. 

Moreover, such a difference would seem to indicate that 
tests of this nature do measure some psychological trait related 
to conflict and may be employed in identifying those individuals 
who, because of their maladjustments, will more than likely do 
poorly in scholastic endeavors. 
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Results and Discussion 

Measures of the reliability of scoring the sentence completion 
tests used in this study were obtained by two methods. First, a 
correlation of .86 was obtained between the scoring the one 
experimenter and a separate scoring of the same ioo tests by 
the other experimenter. A second method of determining the 
reliability or the consistency with which one scorer is able to 
agree with himself, was based on a re-scoring of the same set 
of tests one week later. This resulted in a correlation between 
the two scorings of .83. Both of these coefficients of correlation 
are significant above the one per cent level of confidence and 
would seem to be evidence of the reliability with which such an 
instrument can be scored. 


TABLE 1 

Disagreement between Score? s 


Item 

Per cent 
of Disa- 
greement 

36 Bud would rather do without . 

16% 

39. George was sorry after he . . 

. . • * 5 % 

ij The fact that he failed 

20% 

30. Nothing is so frustrating as 

.... 19% 

4 Nothing annoyed Bob more than 

. . . 17% 

25. Bud’s family . . . ... 

.... 17% 

28. I usually feel awkward when. . ... 

17% 

38 His father . .... 

17% 

3a. He was confused about 

16% 

47. He often thinks of himself as ... 

. 16% 


There were certain items on which the two raters showed a 
high percentage of agreement, conversely, on some items they 
showed less agreement. The median percentage of agreement 
for the fifty items was 91 per cent. Some of the sentence stems 
elicited reactions which required a high degree of discrimination. 
Table 2 lists the items on which there was a disagreement ex- 
ceeding 15 per cent between the two scorers. The sentence 
stems of items 39, 15, 30, 4, 28 and 32 seem to suggest some 
degree of conflict to most indivuduals completing the items, and 
the interpretation of this in terms of a conflict score is largely 
evaluated in terms of the scorer’s interpretation of what might 
be considered an excess of conflict. Items 36, 25, and 38 lend 
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themselves most readily to evasive or non-committal answers 
on the basis of their relatively unstructured stems Item 47 con- 
fronted the scorer with a dilemma in terms of responses that 
could be considered either as an attitude of commendable 
ambition or one that reflected an over-evaluation of self. It is 
suggested that further research might he designed to study the 
various items with the intent of eliminating certain stems upon 
which the reliability of scoring is doubtful. It is anticipated 
that this data and other results of this data may be utilized in 
the construction of an improved form of the test. 


TABLE 3 

Airumetu of Criterion Groups on Fosiiioe Responses 


lltmi 

31 . The war interfered wiih his plans for 

40. What they liked about him most was 

45. 1 always wanted to be 

44. Bud could work beat at 

jo. I take pains 

35. The men under me 

36 . On his evening off, Paul. . .. 

j. Mike’s fondest ambition 

33. Finding no one who could help him, Will . . . 


Per Ccnl of Total 
Responses 


lfl«h 

Achieve m 

r*w 

Achievers 

. 99.I 

100.0 

, 96.0 

100.0 

. 90.3 

95.6 

. 90. 6 

93-6 

• 91-9 

90.7 

8J.I 

88.7 

. 83.8 

86.8 

. 81.6 

84.1 

. 81,0 

83.0 


Other factors must be taken into consideration in addition 
to reliability of scoring. For example, many items yielded 
responses which were rated the same for practically all subjects. 
These items yield high reliability of scoring but will seldom be 
discriminative for any predictive purposes. Items illustrating 
this factor are shown in Table 3. Inasmuch as items 5, 21, 40, 44, 
45 and 50 refer to ideals and ambitions, one would expect most 
individuals to desire to appear in a more favorable light than is 
provided in their present situation. Hence, a response on these 
items may merely reflect a reaction on the verbal level rather 
than an indication of the actual behavior pattern, A similar 
trend may be noted in those items which present a situation 
representative of the individual’s relation to his fellow men as 
in items 22, 35 and 40. To be well liked by others is a common 
desire, and responses to these items tend to be colored by this 
need for acceptance. Item 26 also shows a consciousness of 
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what is socially acceptable in the individual’s expression of his 
preference in recreation. 

Items that elicited negative or conflict responses to a com- 
parable degree of agreement in both criterion groups are listed 
in Table 4. The stem of these items suggests a response reflecting 
feelings of inadequacy or anxiety which are present to some 
degree, however slight, in all individuals Obviously, such items 
are not discriminative in respect to the degree of conflict but 
certainly are of value to the clinician in tapping the source of 
conflict. Consequently, any subsequent test designed for pre- 
dictive use constructed upon the basis of the present study 


TABLE 4 

Agreement of Criterion Groups on Negative responses 


■ 

Per Cent of Total 


Responses 


Hik 1 » 

Low 

Items 

Achievers 

Achievers 

46. He is often at a loss when . . .... 

• 93 -5 

95 6 

19, The thing which bothered Harry’s conscience . . 

89 0 

92,. a 

13 Joe was uneasy because. .... ... 

. . 89 O 

91 5 

34, Joe feels that he suffers most from . . 

. . 84 4 

8 S .l 

18 Every time he wasn’t invited 

O 

80 8 


might be modified by eliminating both low reliability items and 
items which yield mainly positive or mainly negative responses. 
However, the elimination of these stems might reduce the use- 
fulness of the tool as a clinical device. 

It appears wholly possible that if a more thorough and inten- 
sive training period had been entered upon before any attempt 
at scoring was made, that an even greater agreement in scoring 
would have resulted. It must be kept in mind that the sentence 
completion test is a clinical tool and should be subjected to the 
strenuous rules of interpretation that are evident to those 
persons who have had extensive training and experience in 
personality evaluation. One would not, then, expect a high 
degree of compatibility in the scoring of such tests between 
untrained or differently oriented experimenters. The need for 
great clarity of definition becomes obvious when one is dealing 
with such clinical terms as conflict, optimism, hostdity, accept- 
ance or avoidance. Before a consistent quantitative measure 
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can be obtained, such words must be carefully defined and 
redefined. A clarification of such definitions should lessen the 
tendency of the clinician to lose himself in semantic quandaries 
in deciding what constitutes conflict. One would hardly expect 
any agreement of interpretation or scoring in the use of such 
projective devices as the Rorschach Test if those who use the 
test were not thoroughly trained in seminar groups and versed 
in clinical psychology. Similarly, those who employ the present 
test should seek closer agreement on terms and interpretation. 

The internal consistency of the test, examined by means of 
correlating the conflict scores on the odd and on the even items 
for 100 tests, may be expressed in a reliability coefficient of .78, 
stepped up by the Spearman-Brown prophecy formula. Since 
it is difficult to obtain equivalent forms of an even well-struc- 
tured test, the possibility is perhaps even greater in a test of the 
present type that the split made actually results in parts that 
differ to a considerable degree. Thus the degree of internal con- 
sistency found by the above-mentioned process must be viewed 
with some caution since the basic assumption, that is, equiva- 
lent forms, may have been violated in the odd-even split. 
Nevertheless, it was assumed that the random split did deter- 
mine two forms of the test that were sufficiently alike for 
practical purposes to allow such an analysis, and the correlation 
indicated that the two parts did in some way measure similar 
reactions. It is possible that the relationship between the odd 
and even parts of the test might have been greater had the 
scoring reliability been of a higher order than .86. The obtained 
reliability coefficient is significant, however, beyond the one per 
cent level of confidence. This fact may suggest that in spite of 
the assumption of inequivalent forms, the test does measure 
what it attempts to measure with a better-than-chance con- 
sistency. 

Once it was established that there was a high degree of 
scoring reliability and that the tests did have an internal con- 
sistency, the next step was to test the hypothesis that indi- 
viduals who score high tn intelligence but who achieve below 
expected performance in college class work are those who are 
more likely to experience conflict than are persons whose aca- 
demic work is more in accord with their measured general 
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ability. Table I presents the results when the total groups were 
compared. A critical ratio based on the mean difference between 
the conflict scores of the high and the low achievers was found 
to be 2.07. This figure infers that at approximately the 4 per 
cent level of confidence, the two criterion groups do differ as 
far as conflict is concerned. The low achievers, as measured by 
the sentence completion test, do show greater conflict than do 
the high achievers. However, it is evident from an inspection 
of Table 1 that the two groups are not exactly equivalent The 
groups are not matched on sex, term, school or English test 

TABLE 5 


Comparison between Male and Female Students on the Sentence Completion Test 


Sex 


Number 

Mean 

Difference 

Critical 

Ratio 

Male 

Female 

. . 

108 

49 

a. 56 

16 74 

14. 18 

3 67 

TABLE 6 

Comparison by Terms on Sentence Completion Test 

School Term 

8 

7 6 

5 

4 3 

2 l 

Mean Sentence comple- 
tion Score , . 

Number of Students . . . 

*5 5 

4 

7.36 7 83 

7 12 

7-13 8 

19 34 

91 2 9a 

19 

10 73 i.j 

S 3 S 


scores or even on the A. C. E. scores. The significance of the 
differences between mean A. C. E. percentiles and English 
percentiles were not computed. This was not done for two 
reasons. First, an average of percentile scores is a very crude 
measure of central tendency, and second, these comparisons 
are not basic to the present study. The differences are sub- 
stantial and indicate the need for more careful matching. 

In order to ascertain whether any of these differences might 
result in biases which would confuse the basic problem, the 
results presented in Tables 5, 6 and 7 were computed. It is 
noted that the female students included in this sample scored 
much higher than did the male students. The high-achieving 
group includes a larger proportion of females than the low 
group. This may or may not be a biasing factor. Since the female 
students are also typically high achievers, the factor of emo- 
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tional adjustment may be operating. On the other hand, the 
test used was originally constructed for use -with a male popu- 
lation, and the scores on female students may not have the same 
meaning as for the males. For instance, all proper names are 
male. It is barely possible that the girls are not talking about 
themselves. Consequently, it was felt that this factor should be 
controlled. 

Tables 6 and 7 present the mean Sentence Completion ' Test 
scores for terms and schools respectively. 

Table 7 presents comparison by schools on the Sentence 
Completion ‘Test, Some differences are indicated. However, the 

TABLE 7 

Co tnparison by Schools on Sentence Completion Test 
School Number Mean 


Engineering. 

Science 

Pharmacy . 

Trade and Industrial Education. 

Liberal Science 

Home Economica 

Agriculture 

Physical Education. 

Unclassified 


54 

3 l 


<3 

u 

.1 

4 


•43 


4-79 
31 ■ >7 


24.50 

16.43 

ia. 19 


3-59 
n . 17 
23-00 


lack of consistency and in some instances the extremely small 
number of cases make any generalization impossible. Neverthe- 
less, it was felt necessary to attempt to control these factors. 

Table 8 presents comparisons between the low group and a 
matched group of high achievers. This matching was based 
primarily upon the A. C. E, scores, hut an attempt was also 
made to match on the other factors. These groups seem to be 
quite equivalent in every respect except on the English Place- 
ment Test, It is evident that a difference exists between the 
high- and low -achieving groups insofar as the Sentence Com- 
pletion Test scores are concerned. This difference is significant 
at approximately the 10 per cent level of confidence; however, It 
is still in favor of the high achieving group. 

Table 9 presents comparisons between the low group and a 
matched group of high achievers. This matching was based 
primarily upon the English scores, but an attempt was also 
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made to match on other factors. These two groups are roughly 
equivalent on all factors, but are not as well matched as the 
groups described in Table 8 on the A. C. E. and school affili- 
ation. It is evident from this comparsion that a slight difference 

TABLE 8 


Comparison oj Groups Matched on American Council on Education Examination 



High 

Low 

Difference Significance 

Sentence Completion Mean . . 

. 7-21 

.96 

6.15 

I 6l 

Psychological Score Mean. 

.. . 74.50 

74 61 

12 

— 

English Test Mean . 

, . 74.19 

58 96 

U 23 

— 

School Term Mean 

3-98 

3.87 

.11 

— 

Sex- — Male ..... .... 

39 

39 

0.00 

— 

Female . . . . . ... 

. ... 9 

9 

0 00 

— 

School — Engineering 

. 20 

20 

0.00 

— 

Science 

. II 

II 

0 00 

— 

Trade and Industrial Education 2 

3 

1 .00 

— 

Liberal Science 

4 

4 

0.00 

— 

Home Economics . . 

■ 3 

3 

0 00 

— 

Agriculture. ... 

4 

3 

1.00 

— 

Pharmacy 

..... 2 

I 

I 00 

— 

Physical Education. 

... I 

I 

0 00 

— ’ 

Unclassified 

I 

2 

1.00 

' 


TABLE 9 




Comparison of Groups Matched on English Placement Scores 



High 

Low 

Difference Significance 

Sentence Completion Mean 

7.68 

I.09 

6.59 

1.38 

Psychological Score Mean. . . 

. ■ . 78-63 

75-77 

a. 86 

— 

English lest Mean 

62.O9 

61.3a 

i -37 


School Term Mean. . 

.... 3 76 

3 88 

.12 


Sex — Male 

35 

35 

0.00 

' 

Female 

■ 9 

9 

0.00 


School — Engineering 


18 

3 00 


Science 

12 

9 

3.00 


Trade and Industrial Education, .. • 2 

3 

1.00 

— 

Liberal Science 

. .. .5 

4 

1 00 

— 

Home Economics. . . . 

1 

3 

2 OO 


Agriculture .... . 

4 

3 

1 OO 

' 

Pharmacy ... 

. ... 3 




Physical Education, . . 

.... 2 

1 

1.00 

' 

Unclassified ... 


2 

2.00 



exists between these high and low groups. This difference of 
6.59 is approximately the same as the previously mentioned 
differences, but has a lower significance (critical ratio of 1.38). 
This may be due to the reduced number of cases considered. 

It seems reasonable to conclude that there is real (although 
slight) evidence here that emotional conflict as indicated on this 
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test is a factor to be considered in accounting for low scholastic 
achievement in persons of above- average indicated aptitude 
Further research should be directed toward the possibility of 
increasing the accuracy of prediction of academic success by 
including sentence completion test results in a coefficient of 
multiple correlation. Furthermore, it would seem logical to 
investigate the lower extreme of predicted achievement. These 
results concern only the upper extreme of predicted achieve- 
ment. 


TABLE io 


Items that Discriminate between the Two Criterion Groups at the Ten Per Cent Level or Less 


Per cent 

Per cent 


Teal 

of ITip.h 

of Low 

Critical 

Ilem 

Achievers 

Achievers 

Ratio 


Positive Responses 


a 

SS -7 

34.7 

a. Sir) 

4 

43-2 

28.6 

1.828 

39 

34-3 

20.0 

1.894 

40 

96.0 

100.0 

2 031 


Ntzatiec Rfjponsej 


a 

40 . 6 

61 . i 

2.441 

4 

S 4 -o 

69.4 

2 339 

10 

71 .6 

83.3 

I 69S 

39 

G4.8 

77.8 

1.677 


Neuttal Responses 


IQ 

3*7 

0 

2.046 

IS 

3*7 

0 

a. 027 

28 

4.6 

0 

2.28a 

3<3 

25.2 

14-3 

1 . 669 

38 

1 1 .0 

4.1 

1 -63 s 


Since the test as a whole has to distinguish between the 
criterion groups as to conflict, it was thought that a few specific 
items might have been responsible for the discriminations made. 
Critical ratios derived from the differences between percentages 
of the high and the low groups, marked either conflict, positive 
or neutral for each question, were computed. Most of the items 
had little or no discriminative value. For a measure of conflict 
it was felt that some of the items were “dead wood.” However, 
it should be remembered that these items might be very useful 
in the measurement of other personality traits or in the identifi- 
cation of areas of conflict. 
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Table lo presents data on nine items which were found to 
differentiate between the criterion groups at or beyond the io 
per cent level of confidence. This table illustrates the fact that 
some items discriminate when positive responses are considered 
and still other items discriminate on the basis of neutral re- 
sponses. 

The number of items that discriminate significantly at the 
10 per cent level of confidence is small and is about that which 
would be expected from chance alone on a test of this length. 
However, insofar as positively and negatively rated responses 
are concerned, the differences are in the direction of a greater 
number of positive responses for the high group and more 
negative responses for the low group. Furthermore, when the 
critical ratios are plotted, the curve is skewed in the high 
positive direction. Further research should be designed to con- 
struct a test from the positively discriminating items, which 
would then be applied to a similar group. The present study is 
thought to provide basic data for the construction of a more 
reliable and more discriminative test for the prediction of 
academic success. It should be emphasized, however, that many 
items not discriminative for the present purposes may be dis- 
criminative for other predictive purposes. 

Conclusions 

For the particular sample of students selected, in light of the 
technique employed in this study and on the basis of the results 
presented, the following conclusions may be drawn: 

1 . A relatively high degree of agreement between two sepa- 
rate scorers and on one scorer repeating the task, was found to 
exist in the estimation of conflict as reflected by responses to a 
sentence completion test. 

2. Some indication of reliability of the sentence completion 
test as a measure of conflict was established by the odd-even 
technique. Further investigation, assuming no marked changes 
of personality in the intervening period, should further establish 
the reliability of this type of projective technique. 

3. The discrepancies found between high- tested intelligence 
and relatively low scholastic achievement may in part be attrib- 
uted to emotional disturbances. The use of the sentence com- 
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pletion test in identifying those individuals who may do poorly 
in college course work because of emotional immaturity seems 
promising. 

4. Certain items were found to have more discriminatory 
value than others in measuring conflict. Too hasty elimination 
of those items that do not appear to discriminate conflict 
among high and low achievers does not seem advisable. Valu- 
able ciinical information may be derived from all items which 
not only throw light on the entire personality structure but 
also uncover specific areas and possible causes of emotional 
maladjustment. 

5. The following areas of further research are suggested: 

(a) Use of sentence completion tests to evaluate more 
specific traits of personality, 

(b) Construction of sentence completion tests for specific 
purposes, such as the prediction of academic success. 

(c) Use of sentence completion tests in the prediction of 
achievement in other relatively unstructured situ- 
ations and activities. 

(d) Study of a group of individuals of low predicted 
achievement. 

(e) A repeat study in which the test Is administered at 
the beginning of academic work. It is considered possi- 
ble that the degree of conflict indicated in the present 
study may be the result of poor achievement rather 
than the cause of it. 

(f) Comparison of measures of conflict with discrepancies 
between achievement based on college entrance ex- 
aminations. Perhaps the relationship between conflict 
and achievement is not a straight line function. Extra- 
ordinary achievement beyond predicted achievement 
may be motivated by conflict. 

Finally, it is felt that the present exploratory study may open 
up new and valuable areas of research in two somewhat diver- 
gent fields, First, the use of projective techniques and par- 
ticularly the sentence completion test as predictive or selective 
tools shows some promise. Secondly, an approach is suggested 
for the evaluation of the many reasons why college students do 
not always achieve as expected. 
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THE MEANING OF A COMPREHENSIVE STUDENT 
PERSONNEL PROGRAM 

ELLIS WE1TZMAN 
The American University 

A comprehensive student personnel program should serve 
the end of unification and direction of all of the diverse activities 
of the university which impinge upon the student in order that 
these may be coordinated in a manner designed to accomplish 
the stated objectives of the entire institution. In view of this 
conception of the purpose of a student personnel program in a 
university, the writer here presents a discussion of the reasons 
that the many college bureaus and services properly belong 
within the framework of a meaningful and comprehensive stu- 
dent personnel program. 

Although great variation exists in the avowed objectives of 
American colleges, it is safe to say that practically all institu- 
tions subscribe to one or more of the following aims : To prepare 
for responsible citizenship, to prepare for avocation, to prepare 
for wholesome life adjustment. Despite considerable divergence 
of emphasis and language, one might summarize with the 
statement that the institution of higher learning seeks to de- 
velop people into well-adjusted and socially productive mem- 
bers of the community. Whereas some colleges place their major 
emphasis upon academic achievement, others place it upon 
social maturity, or character development, or success in the 
professions, or the attainment of an understanding of them- 
selves and the world about them, depending largely upon the 
educational philosophy of the current administrative head. 

The attainment of any of these diverse objectives must rely, 
ultimately, upon a thorough understanding of the individual 
student; his drives, his capacities, his personality structure, his 
intelligence, his past experiences, his physical condition — in 
brief, the totality of traits which make of him a unique and 
dynamic entity. Certain essential facts must be known about 

671 
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the individual student. Students cannot be truly evaluated and 
understood in mass any more than souls can be saved in 
bundles. The qualities of most importance in achieving the 
avowed goals of higher education must be known for the indi- 
vidual as individual. 

Modern psychological and educational research have made 
considerable progress in providing diagnostic instruments which 
aid in the understanding of the student. These devices have, to 
date, been chiefly valuabLe for diagnosis. They are merely 
suggestive of the more positive remedial and developmental 
procedures without which mere diagnosis is a sterile and self- 
pleasing process. The clinical tools, however, are indispensable 
to a sound and scientific insight into the characteristics of the 
individual student. It is for this reason, therefore, that the 
student personnel program is generally centered about the 
psychological and guidance services. 

The widespread existence of medical services (as well as 
athletic programs) in American colleges bears testimony to their 
recognition that the physical characteristics and health status 
of students are important factors in their adjustment and prog- 
ress. Positive developmental objectives are met through such 
means as intra-mural sports and required athletic or military 
training programs. It should be obvious that close working 
relationships are desirable between the medical and health 
services and the psychological, academic, and social services of 
the college. Without complete medical information, for example, 
the psychological diagnosis can yield highly deceptive, if not 
completely fallacious, results. For its part, the medical service 
cannot afford to neglect the psychosomatic aspects of the stu- 
dent’s ills. 

Most colleges have long since recognized the need for and 
importance of student social activities. Such recognition has led 
to the establishment of directors of campus social activities. 
Sometimes the title of the office indicates clearly its function. 
At other times, direction of social activities is part of the over-all 
duties of deans of men, deans of women, or directors of student 
personnel, Here again, a sound program is designed to allow for 
the individual differences and needs of the students. 

The social activities program of the student should take into 
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account his academic achievement, his health limitations, his 
need for socialization, his degree of withdrawal or outgoing 
personality qualities, and even his financial status. Social activi- 
ties are not equally beneficial to all persons. For certain stu- 
dents, under certain conditions, they may even be decidedly 
harmful. It is apparent, therefore, that integration with all of 
the other student personnel facilities is necessary to insure 
that the social program is an aid in achieving the develop- 
mental objectives of the institution. 

Faculty Advisors, or Counselors, (or whatever may be the 
title applied to those who set up the study program for the 
student) have a real responsibility for seeing to it that the 
academic program is in harmony with the needs, abilities, in- 
terests, vocational and developmental needs of the individual 
student. This they cannot do unless they have available for 
use the information provided by the various services already 
mentioned. True enough, at time of first registration, most of 
the information required is not yet available. There does exist, 
however, a body of facts which may be derived from the applica- 
tion blank, the office of admissions, or the university examiner. 
In addition, there are such data as high-school record, college- 
aptitude testing, the expressed desires of the student, and other 
usable types of information After first-semester registration, a 
growing body of facts, as well as an achievement record, is 
available. This increased knowledge should provide a more 
realistic and better-informed academic counseling subsequent 
to the first-semester registration. The work of the institution 
will fall short of its objective to the extent that the academic 
program is out of harmony with the needs, capacities, and 
drives of the individual student It is to be noted here that the 
greater the freedom of course-choice in the institution, the 
greater the need for a rich informational basis in determining 
course schedules. 

Tlie progress a college can make towards its goal of student 
development is determined to a considerable extent by the 
nature of the people it admits, i.e., the end product is limited by 
the quality of the human material with which it works Al- 
though much can be done to improve social characteristics, to 
change the student’s attitude towards himself and others, the 
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college cannot be expected to elevate, to any appreciable degree, 
the intelligence quotient. Nor can the college be expected to 
counteract completely the effects of an unhappy home back- 
ground, or to overcome fully any undesirable effects of the 
student’s experiential background from birth to mid-adoles- 
cence. Since the alumnus will, regardless of the university’s 
efforts, in many respects show a strong resemblance to the 
initial entering Freshman, the selection process will always re- 
main a vital part of the student personnel program. This means 
that those responsible for admissions must be fully cognizant 
of the aims and purposes of the university, using selection 
techniques carefully designed to abet the institution’s major 
and long-range goals. 

No academic program can guide the growth of its students in 
a comprehensive way without the active cooperation of its 
instructional faculty. The instructors must not only refrain 
from sabotaging the program but must be actively engaged in 
relating their classroom and extra-classroom student contacts to 
the student’s wider needs. The student’s classroom performance 
should be evaluated not only against a general class standard, 
but also in terms of his interests, his learning aptitudes, his 
work or social activities, his emotional stability, and all other 
factors pertinent to what may be reasonably expected of him. 
The instructional staff should be an integral part of the person- 
nel program to the extent of contributing valuable information 
about thestudent as well as gaining new insight into the student 
from the information contributed by all the above-mentioned 
student personnel facilities. 

As a minimum beginning step, the faculty should be educated 
to the belief that the over-all program is not only worthwhile, 
but vastly more important than what occurs in a single class or 
course area. This step involves genuine realization that the 
major problem is not the learning of a particular subject matter, 
but the development of the student as a totality. The key to this 
attitude is the conviction that the focal point of the instruc- 
tional program should be not the factual material presented, but 
the student rather than the syllabus, and what happens to the 
student as a result of his relationship to the class, the material, 
and the instructor. The emphasis must be upon the student as a 
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dynamic organism, not upon the textbook. In brief, teachers 
must realize that they are teaching people as well as subject 
matter. The importance of what is taught is not in any sense 
lessened by the realization that the learner is a complex of likes 
and dislikes, desires and aversions, fulfilling course require- 
ments according to his own particular conative as well as 
cognitive processes. The degree to which the faculty will take 
this larger view (and, by the same token, the degree to which 
they will cooperate in the total student personnel program) 
is determined in major part by how closely they themselves are 
involved in the work and planning of the intermediate and long- 
range aims of the institution. 

A program cannot be forced upon the instructional staff from 
above through the “power of authority.” Whenever such at- 
tempts have been made, they have failed miserably. Authori- 
tarian pressure, moreover, is a poor educational technique, one 
particularly out of place in a democratic nation. At best, sheer 
administrative force results in an outward show of compliance 
which masks inner discontent and rankling. The best of those 
teachers out of sympathy with the program will soon gravitate 
elsewhere, leaving behind those colleagues with lesser ability 
to remove themselves to more agreeable academic pastures. A 
program for student personnel which seeks, therefore, truly to 
integrate all of the functions of the university toward a single 
clear-cut educational objective, must first develop a spirit of 
genuine cooperation in that largest and most powerful of all 
academic groups — the faculty. 

Most universities maintain student placement services. These 
services are sometimes regarded as of minor importance, al- 
though often they are well financed, well staffed, and genuinely 
useful to a fair proportion of the student body. Only rarely, 
however, are such services integrated into the over-all program. 
Part-time job placement, for example, should serve more than a 
narrow and immediate monetary need. Part-time work can have 
great value in enriching the occupational information of the 
student. It can serve as a valuable exploratory experience for 
the selection of one’s life work. It also results in establishing a 
set of social contacts. These may be either positive or negative 
in value, depending upon their effect on the student. In any 
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event, the placement office cannot serve the end-goals of stu- 
dent development unless it places students on jobs in accordance 
with the information furnishable by the psychological and 
health, social and academic facilities as to the hours, conditions, 
and types of work most suitable, hull-time job placement, 
generally occurring upon course completion or graduation, calls 
for even far greater care and consideration. Within the limita- 
tions of the prevailing socio-economic conditions at the time of 
placement, all that has been learned about the student- — his 
abilities, his motives, his needs and his training — should be 
brought to bear in such a manner that he is most advan- 
tageously placed in terms of both himself and of the society the 
institution seeks to serve. To place the student without regard 
to all of these factors is to render, in the long run, a genuine 
disservice to both the graduate and the employer. It follows 
logically, therefore, that the placement bureau must also be 
part of the pattern designated as the student personnel program. 

In addition to the fund-raising activities, and in addition to 
its value in perpetuating “school spirit," the alumni office 
can also serve a vital function in the student personnel program. 
Real evaluation of what the college has accomplished must wait 
upon post-academic follow-up. Since the alumni office retains 
contact with the student after he has left the campus, the per- 
sonnel service can use this channel to appraise the effectiveness 
of its efforts. Periodic alumni surveys should be conducted 
with a view toward determining not only the immediate, but 
the long-range results of residence in the academic community. 
Some of the questions involved are: Have the attitudes and 
factual knowledge present at graduation persisted? Has the 
training at college been applied to post-school life? Has the 
graduate been active in community affairs? Has he maintained 
cultural interests? These are but a few of the many questions 
to which at least approximate answers are obtainable by means 
of surveys carefully developed by persons expert in this type 
of study. In such manner, the college can evaluate not only the 
consequence of its efforts and the validity of its claims, but 
also the effect of any changes in the selection and training of 
students, and the results of any shift in educational philosophy 
or emphasis. The alumni office, at least to the extent involved 
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in this discussion, must therefore be regarded as an important 
part of the total tapestry of a comprehensive student personnel 
program. 

An attempt has been made in the preceding paragraphs to 
present an overview of what the author means by the Student 
Personnel Program. To have the major significance it deserves, 
it must be viewed in this larger light as a major and all-in- 
clusive instrument of the educational structure. Its function is 
so molar and comprehensive that it cannot be viewed intelli- 
gently apart from the entire matrix of higher education. Almost 
inevitably, one is forced to start with the end-goal of the 
pedagogic process before the individual parts or steps can be 
meaningfully arrayed and appraised. 

Any half-hearted half measures are foredoomed to failure. 
A partial program can at best meet only with partial success. 
The same can be said for a complete program in which all the 
parts are disconnected and independent. Just as the disarrayed 
pieces of a puzzle fail to form a meaningful pattern, so do 
disjointed services fail to create a functional program. Com- 
partmentalized bureaus, coordinated only in terms of an on- 
paper relationship, each regarding itself as holier-than-thou, 
each going blithely upon its way with indifference to what is 
being done on other parts of the campus, do not in any sense 
of the word constitute a comprehensive and functional per- 
sonnelprogram. 




THE VERBAL COMPONENT IN MATHEMATICS 

ITEMS 


LYNNETTE B. PLUMLEE 
Educational Testing Service 

I. Background and Purpose of Study 

In the past, mathematical aptitude tests of the College 
Entrance Examination Board included problems which con- 
tained few or no words, since it was assumed that if mathe- 
matical aptitude were to be tested most fairly, the verbal factor 
should be eliminated as completely as possible. This elimination 
of words was carried to the extent of assuming that 


would be understood by the examinee to be a problem in 
simplification. The so-called aptitude test, furthermore, re- 
quired a fair amount of algebraic achievement on the part of 
the candidate. 

With the inception of new mathematical-aptitude testing 
programs, a more or less complete reversal of policy took place 
with regard to the wording in mathematics aptitude problems 
In an attempt to test arithmetical-reasoning ability as apart 
from achievement, some of the newer tests consisted entirely of 
word problems, such as: 

If an old engine required n quarts of oil per month and a new 
engine requires 60% as much od, how many months will the 
new engine run on the amount of oil used by the old engine 
in t months? 

Other tests contained varying proportions of the two problem 
types. 

Two of the questions which arose in the course of deciding 
the proportion of each type of problem to be used in a given 
test were: 
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i. Are the two test types, rinn-verli.il mathematic* an<l verbal 
mathematics fillu-ararcd almve) equivalent, i.e., are they 
measuring the same abilities? 

1 . K there a higher degree of relationship lietiveen verhal 
aptitude anti verbal mathematics than Iietween verbal apti- 
tude and non-verbal mathematics? 

The purpose of this paper is to report evidence, gathered 
from three tests, concerning the answers to these questions. 


It. T> efts and Populations 

The three tests on which the study is based may be described 
as follows: 


Test A 

FtvfwlAlfm*. 407 womrn, swnc * f wh»*m bad lerrn out vi rthf*c*I many year* 

run I I’art II 

Subjtvt Mailer Verhal AjOitudr, • 'in'iMiiwnf an Maihenial.it * Aptitude, uvmming 

Coverage tuflyim Afl'l ‘"fir kni»wlt-flgc of algebra and 

I'Unc gr«MWciry 

Number of 7? 35 

Qu mi ions 


Time Allowance >0 50 

(in minutes) 

Tent B 

lfafvuUlUtn. men, w>mc of whxmt tray h«i% t Iwen mil *»f ndufed many year* 

Pan l Part II 

Subject Mailer Verbal Aptitude, t«m»i .ting of ,m. Malhrmah' t Aptitude, asrsuinliig 

Coverage tonymw, arabisse*. ami renum? rt un” kiwwIrdHc of algebra and 

torn j >U' Horn t*lanr geometry 

Number of 170 50 

Qua linn* 


Time Allowance 


60 


60 

(in minute) 

»tc 

Population- f/07 men, 

, at the end of their lint semmer of toilette 



Pan I 

1‘ari 11 

fan m 

fart IV 

SubjecbMniur 

Malhtimttiit* 

Verbal Apti- 

Grammar 

Paragraph 

Coverage 

Adiirvewptii, 
covering al- 
gebra, trig- 
onometry, and 
Grat-seme-ncr 
college rnalhe- 
ma flea 

tude, r*.'n»i-Uh« 
of antonym's. 
fti*al»«irri, and 
sentence tom- 
completions 


Reading 

Number of 

75 

80 

>5 

50 

Questions 

Time Allowance 

iH) 



too 

(In minuica) 


Part V 
WorcUnww, 
involving the 
elimination 
of unnecessary 
words 
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III. Procedures 


The problems in each test were classified as verbal or non- 
verbal by using the following two questions as criteria: 

I, Can one work the problem without understanding the word- 
ing? 

i. Is the problem stated as formally as possible? 
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An affirmative answer to both questions classified the problem 
as non-verbal. Where the answers to the two questions were 
opposed and equally strong, more emphasis was placed on the 
first question. In answering the first question, we assumed that 
mathematical terminology would be understood in a foimally 
presented problem. It was considered that terminology such as 
the following did not classify the problem as verbal - “negative 
terms in expansion,” “the point . . . lies on the line,” “identi- 
cally equal,” “what is the value of . . in terms of . . . ?,” “is 


TABLE i 



Number 


Standard 


Teat 

of Items 

Mean 

Deviation 

Reliability* 


Test A 


Verbal Aptitude 

7 5 

45.8 

H 3 

92 

Mathematics 

Verbal mathematics 

14 

6 5 

2 8 

58 

Non-veibal mathematics 

21 

9 0 

4 .3 

78 

Total mathematics 

35 

IS . 5 

6.8 

.84 

Test B 

Verbal Aptitude 

170 

78 T 

20.4 

■94 

Mathematics 

Verbal mathematics 

15 

* 3-9 

3 8 

61 

Non-verbal mathematics 

aj 

13 3 

; 3 

.81 

Total mathematics 

5 ° 

W 3 

8 4 

84 


English 

Verbal Aptitude 80 

Paragraph Rending 30 

Total English! * 7 * 

Mathematics 

Verbal mathematics _ 33 

Non-verbal mathematics 42 

Total mathematics 75 


40 2 

12.4 

.88 

15 4 

4 3 

.62 

309 4 

29.0 

93 

14-3 

4 5 

62 

18 4 

6.6 

78 

31 7 

10 3 

.84 


* Kuder-Richardbon formula 21 (see footnote). 

t Total English includes all four English Parts (II, III, IV, and V) of Test 


C. 


equivalent to which of the following values?”. Tables or graphs 
with explanations were considered verbal. 

Means and standard deviations for part scores are reported 
in Table i. The reliability figures given in this table were 
obtained by using the Kuder-Richardson formula 2.1 1 This for- 
mula assumes that inter-item correlations are equal, that item 


1 r t t =* — — ■ — — where m is the correlation between equivalent forms of a 

test, n is the number of items, <rt is the standard deviation of test scores, is the 
average per cent answering each item correctly, and q is the average per cent answer- 
ing each item incorrectly. 
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difficulties are equal, and that all examinees try all items. Since 
these conditions were not entirely true for the tests in this 
study, the reliability figures are probably lower than those 
which would be found by using the Spearman-Brown split-half 

TABLE i 

I Htcreorrtltttioits 

Vcfh.il Non-Verbal Tolal 
MatheouUc.1 Mathematics Mathematics 

Test A 

Verbal Aptitude 
Verbal Mathematics 
Test B 

Verbal Aptitude 
Verbal Mathematics 
Non-Verbal Mathematics 
Test C 

Verbal Aptitude 
Paragraph Reading 
Total English* 

Verbal Mathematics 
Non- Verbal Mathematics 

•Total English includes ail four English Parts (II, 111, IV, and V) of Test C. 


•u 

• 35 
■73 


S3 

■ 43 

•47 


.69 

.89 

•94 

29 

• 30 

•32 

43 

.40 

-45 

4° 

■ 4° 

•43 


• 72 

.89 

•95 



Tent A 

Score on flon-Yaibnl KslhrnnVlrd It-rra 

Figure I 

method. A more exact Kuder-Richardson formula was not 
feasible, since certain basic data were no longer available for 
all tests. 

It will be noted in Table i that the number of verbal mathe- 
matics problems was equal to the number of non-verbal mathe- 
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matics problems in Test B only. In the other two tests, the 
ratio was about 1 to 3 in favor of the non-verbal. Intercorrela- 
tions among the question types are shown in Table 2. 

Figure I shows for Test A a plot of scores on the verbal 
mathematics problems against scores on the non-verbal mathe- 
matics problems. A line has been drawn representing the scores 
on the verbal mathematics items which correspond to those on 
the non-verbal mathematics problems. That is, the line passes 
through the mean of both sets of problems and through all 
points which are in the same position, in terms of the standard 
deviation and relative to the mean, on the two scales. 

IV. Analysis of Results 

When answering the first of the two questions asked at the 
beginning of this report (i.e., are the two mathematics test 
types equivalent?), one should note that there is wide variation 
in subject-matter content among both verbal and non-verbal 
mathematics problems in these tests Hence, little significance 
can be attached to any differences among the means or the 
standard deviations. It will be seen that the reliability of the non- 
verbal mathematics type is consistently higher than that or the 
verbal mathematics type. As pointed out earlier, however, the 
conditions assumed in the Kuder-Richardson formula by which 
these correlations were computed were not entirely fulfilled, 
and hence too much reliance should not be placed on the 
coefficients obtained. The correlations between questions types 
are sufficiently high in comparison with these reliability coef- 
ficients, however, to suggest that, if chance and measurement 
errors were eliminated, we should expect the two types to 
correlate highly, although probably not perfectly. At any rate, 
it is reasonable to assume on the basis of the presented data 
that they are measuring abilities which are quite similar. 

In answering the second question (i.e., is there a higher degree 
of relationship between verbal aptitude and verbal mathematics 
than between verbal aptitude and non-verbal mathematics?), 
one will note that the correlation between verbal aptitude and 
verbal mathematics is not consistently different from that be- 
tween verbal aptitude and non-verbal mathematics. The fact 
that these correlations are under .45 in each instance indicates 
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that the difference in the abilities measured by the verbal 
mathematics and the non-verbal mathematics types, whatever 
these abilities arc, is not closely related to verbal aptitude. 

It will be seen in Figure I that, for lower-scoring examinees, 
the frequencies tend to spread more into the upper left comer 
than into the lower right corner. That is, the verbal mathe- 
matics score, relative to its mean, exceeded the non-verbal 
mathematics score, relative to its mean, for the greater number 
of candidates. The tendency may be at least partly explained 
by the number of years since a large portion of the population 
had studied formal mathematics, a fact which may, in large 
part, have accounted for the lack of perfect correlation between 
the abilities tested. At any rate, persons with high non-verbal 
mathematics scores do not appear to have been handicapped 
seriously, if at all, by the verbal factor in the verbal mathe- 
matics problems. 

V. Conclusions 

It seems safe to conclude from these data that the student 
who lacks verbal facility is not handicapped to any greater 
extent on verbal mathematics problems than on non-verbal 
mathematics problems. The evidence suggests that these two 
types of problems measure abilities that are highly but not 
perfectly correlated. 



MULTIPLE-CHOICE RORSCHACH RESPONSES OF 
COLLEGE ACHIEVERS AND NON-ACHIEVERS 


R T OSBORNE 
WILMA B. SANDERS 
University of Georgia 

Purpose 

The purpose of this study is to evaluate the Harrower Mul- 
tiple Choice Rorschach Pest as an aid in diagnosing and dif- 
ferentiating between achievers and non-achievers attending the 
University of Georgia In order to accomplish this end, re- 
sponses to the test were used in two ways. First, according to 
the method outlined in Harrower-Steiner (i), in which sta- 
tistical weights for “good 11 and “poor” responses are rated on a 
ten-point scale. Second, a “content” or item analysis similar to 
the procedure suggested by Zuckerman (6) was made for each 
of the 300 possible responses. 

Population 

The subjects for this study were University of Georgia stu- 
dents selected in the following manner: The probation group 
(non-achievers) was composed of 15S students who were placed 
on academic probation at the end of the Winter Quarter, 1948. 
The non-probation group (achievers) was selected from classes 
in Psychology during 1947-1948. No member of the latter 
group was, or had ever been, on academic probation. It was not 
possible to equate the two groups for intelligence or previous 
educational experience. The average age in the non-probation 
group was somewhat higher than in the probation group, but, 
otherwise, they may be considered comparable for practical 
purposes. 

Procedure 

The basic assumption for the Harrower Multiple Choice 
Rorschach Pest is that those individuals most likely to give 
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certain types of responses, when responding freely in the 
Rorschach method, will select such responses when confronted 
with them in a multiple-choice situation. The form of the test 
used in this study is composed of 300 possible responses divided 
into three groups of ten each for each of the ten Rorschach 
plates. Weights or scores are assigned to each of the ten re- 
sponses according to the scale of values given in Harrower- 
Steiner, op. cil. Harrower suggests calling responses numbered 
one to five, Good; those numbered six to ten, Poor. 

Standard procedure was followed in administering the ex- 
amination to 158 University students on academic probation, 
and 93 non-probation students. The test results were coded and 
punched on Hollerith cards. 

Table 1 gives the mean weighted score of the multiple-choice 
responses of probation and non-probation students. From this 
table it is seen that, with one exception, all differences favor the 
non-probation group, i.e., the probation group tends to choose 
responses in the direction of the poor or Heavily weighted items. 
The average for the non-probation group was below the Har- 
rower cutting point between good and poor answers for only 
one of the 30 response groups. The average for the probation 
group was below the cutting point in eight out of 30 cases. 
Further examination of Table 1 led the writers to suspect that a 
modification of the Harrower critical scores was in order for the 
two groups under study. Accordingly, critical scores, or points 
of over-lapping of the two curves, were obtained for each of the 
response groups. In this way a variable cutting point was 
obtained for each group of weighted responses. The new cutting 
points between good and poor responses are shown in Table 
1, Column 8. For example, for Card I, Response Group A, the 
point of overlapping was found to be between responses five 
and six. This coincides with Harrower’s cutting point between 
good and poor answers. However, Response Group B for 
the same card under the new system has a cutting point be- 
tween responses seven and eight. For the remainder of this 
study, instead of calling responses good or poor, we will call 
those below the critical score “probation signs,” and those 
above the critical score, “non-probation signs.” Using the list of 
probation signs that appeared to be the most predictive (those 
indicated by an asterisk in Table 1), it was found that 77 per 
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TABLE 1 


Differences tn Mean Weighted Scores oj Achievers and Non-achievers on Harrower 
Multiple Choice Rorschach Test 


Card Number 
and 

Response Group 

Mean 
Non-Ach. 
N - 158 

SD 

Non-Ach. 

Mean 

Ach. 

N - 93 

S.D 

Ach 

Diff 

Means 

C/R 

Cutting 

Point 

Between 

X A* 

3-21 

1 .98 

3.73 

1 26 

.48 

2.29 

5-6 

X B 

3.98 

2 60 

3 - 37 

I 92 

■71 

2.45 

7 -s 

1 

4' a 3 

a. 50 

4, IO 

3 45 

.13 

.41 

4-5 

I Average 

3.77 

I 62 

3 3 i 

1.34 

.46 

2.42 

3-4 

II A* 

4 5 6 

3-21 

2.68 

2.30 

1.88 

5 37 

S-6 

11 B* 

5.09 

3.38 

2 75 

2 19 

2.34 

6.69 

4-5 

11 C* 

5-54 

3 • ao 

3-45 

3.75 

2.09 

5 5 ° 

3-4 

11 Average 

5.OO 

3.75 

2.98 

1 93 

2.08 

6.93 

4-5 

III A 

I 90 

1.84 

i .66 

I 40 

.24 

1 J 4 

3-4 

III B 

a. 25 

a 58 

1. 71 

1 95 

54 

1 86 

3-4 

III C 

a. 91 

a. 87 

2.13 

2.22 

.78 

2 36 

6-7 

III Average 

a. Si 

3.03 

i .84 

1 .31 

.67 

3 19 

4-5 

IV A 

4.91 

a. a8 

4 .20 

I.90 

•71 

2 63 

4-5 

IV B 

4 8 7 

3.97 

4-33 

2.30 

54 

1 59 

6-7 

IV C* 

4.70 

3.38 

3 . 8 $ 

2.87 

•8S 

2 13 

4-5 

IV Average 

4.81 

2. l6 

4 15 

1.46 

.66 

2.87 

5-6 

V A 

3-39 

1 * 54 

2.46 

I.69 

-.07 

.32 

4-5 

V B 

3-41 

2 70 

2.61 

1. 91 

. 80 

2.67 

7-8 

V C 

3.15 

1 -33 

2.08 

1 '33 

.07 

•39 

4-5 

V Average 

1 59 

I. *3 

2.40 

I . l6 

.19 

1 19 

3-4 

VI A* 

4 93 

3-59 

3.45 

1 62 

1 .48 

5 48 

4-5 

VI B* 

4.73 

3 57 

3.87 

2 01 

•85 

2 93 

4-5 

VI C 

4.89 

a. 78 

4-54 

a 50 

35 

1 °3 

4-5 

VI Average 

4 85 

I.O7 

3-97 

1.30 

.88 

4.19 

S-6 

VII A* 

4.67 

3-37 

3-33 

2.86 

1-35 

3-38 

3-4 

VII B* 

4.71 

2.84 

3.69 

2 72 

I 02 

2 83 

2-3 

VII c* 

S. 9 ° 

2 84 

4.69 

2.71 

I .21 

3 3 6 

7-8 

VII Average 

S 08 

a . 31 

3.94 

2.07 

1. 1 4 

4 07 

5-6 

VIII A* 

5 -iS 

a. 24 

3 63 

1-75 

1.52 

6 08 

4— S 

VIII B+ 

4-49 

2 27 

3-33 

1 .93 

1 17 

4-33 

2-3 

VIII C* 

6 60 

2,50 

5.62 

2 84 

.98 

2 80 

2-3 

VIII Average 

5 - 5 I 

1.75 

4 20 

1 76 

i- 3 ' 

5.70 

4-5 

IX A* 

5.38 

2 76 

4 39 

2.48 

99 

2.91 

5-6 

IX B+ 

5 60 

2.97 

4-49 

3.74 

I.IX 

3 -oo 

8-9 

IX C* 

5.94 

3.77 

4-99 

2.42 

■95 

2 88 

8-9 

IX Average 

5 58 

2,09 

4 7 ° 

1.76 

88 

3 52 

S-6 

X A* 

3.08 

2, 10 

2.61 

1,22 

•47 

2.24 

6-7 

X B* 

4.91 

3 -°S 

3.58 

2.43 

I -33 

3 -So 

4-5 

X C* 

4.6a 

3.93 

3.10 

1. 85 

I 52 

5 °7 

3-4 

X Average 

4.33 

2. 13 

3-°5 

I 29 

I. 18 

5. 6a 

4-5 


* These response groups were used as probation signs. 


cent of the two groups studied could be correctly placed by 
using six probation signs as the critical number of signs indi- 
cating probation. Seventy-eight per cent of the probation stu- 
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dents and 75 per cent of the non-probation students were so 
assigned by this method. (See Table 2.) 

Another approach to the same problem was made through 
content or item analysis of the individual responses to the Mul- 
tiple Choice Rorschach Test. This time, instead of analyzing the 
data for good or poor responses, the percentage of students 
choosing each of the 300 possi bte responses was compared. ; 

TABLE 1 

Number and Percent oj Achievers and Nan-aehieeers Falling Above and Be/owthe "Cutting 
Point” a it IQ Selected Hamtser-Fsickion Multiple Choice Response Groups 

Tout 

Nou-Achievcra AcMtvtri 

^ ^ __ No. ® No. % 

6 or more Probation sign? 114 78 S3 13 

Fewer than 6 Probation signs 34 11 70 75 


TABLE 3 

Multiple Choice Rorschach Responses Chosen Mare Frequently tj Non-achievers 
than Achievers 


Card Number, 
Group and Key 
Number 

” ~n a 9 

11 B 9 
II C 9 

IV C 9 


V 

V 

V 
VII 

IX 

IX 
IX 

X 


1 

6 

1 

9 

9 

9 

10 


B 8 


Rchjoom 

Red and black inic 
Red and black splotches 
Black and red paint 
An empty hole 
Something squashed 
A frightening picture 
A moth 
A pelvis 

A bat or butterfly 
A gray mess 
Just spilt paint 
Messy colors 
Nothing at all 
A medical picture 


Table 3 shows card number, identifying letter, and number 
of responses, which were chosen more frequently by probation 
than non-probation students. Table 4 lists the responses which 
were chosen significantly more frequently by non-probation 
than by probation students. It is seen from these two tables 
that some plates elicit more probation signs than others. For 
example, no response on either Card I or Card III appears to 
discriminate between probation and non-probation groups. 
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However, on all other plates there was at least one probation 
sign. The card most productive of probation signs was Card 2. 
On this card eight of the 30 possible responses were chosen 
significantly more frequently by one or the other of the two 


TABLE 4 

Multiple Choice Rorschach Responses Chosen More Frequently by Achievers than 

Non-achievers 


Card Number 

Group and _ 

Key Number Response 


II A 1 
II A a 
II B 1 
II C 1 
II C 1 
V C 1 


V C 4 
VI A 3 


VII A 
VIII A 
VIII B 
VIII C 
IX A 
IX c 

ix c 

X B 
X C 


Two clowns 

Two scotcie dogs; two elephants 
Two bears rubbing noses 
Two witches 
Bears’ heads 
A fan dancer 

An alligator’s head; legs; a pair of pliers 

Two kings’ heads . . , a fur rug 

Two women talking 

Two bears climbing 

Two animals climbing 

Frogs’ heads, two beavers walking 

Sea horses; flowers; a candle 

A tropical flower or orchid; lobsters; men’s faces on the sides, a violin 
An explosion; storm clouds at sunset 
Undersea pictures, a design for wallpaper 

Octopus and crabs 


TABLE ; 

Number arid Percent of Non-achievers and Achievers Selecting Above and Be/oio the 
Critical Number of Probation Signs on Harrower Multiple Choice Rorschach 


Total 


10 or more Probation signs_ 
Fewer than 10 Probation signs 


10 or more Probation signs 
Fewer than lo Probation signs 


10 or more Probation signs 
Fewer than 10 Probation signs 


Non -Achievers 

Achievers 

No 

% 

No. 

% 

107 

68 

11 

13 

51 

31 


87 



Female 


35 

75 

7 

l6 

11 

44 

38 

»4 



Male 


80 

7 1 

l6 

33 

32. 

29 

31 

67 


groups studied. Table 5 shows that by using item analysis of 
the responses approximately the same percentage of the non- 
achievers and achievers are correctly placed as by using the 
Harrower system of cutting between good and poor answers. 
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Using content analysis of tKe Multiple Choice Rorschach, 13 
per cent false positives and 32 per cent false negatives resulted. 

Results 

As inconclusive and sketchy ns this study is, there do appear 
to be some Rorschach interpretations that might give a picture 
of characteristics which are typical of the two groups: 

No n -A ch i c vers (a ) Probation students as a group tend to 
show significantly more signs of dysphoria and anxiety; (b) 
oppositional tendencies were more frequent in the probation 
group; (c) color shock manifested by deviation in form and 
content was present; this is sometimes interpreted to indicate 
inefficient use of mental capacities or the presence of emotional 
disturbances without intellectual control; (d) there was lack of 
attention to details, anti (c) vague, formless, whole answers 
were more frequent in this group. 

Achievers. --(a) Non-probation students as a group tended to 
demonstrate greater control on the intellectual level (P +) ; 
(b) non-probation students show considerably more human 
movement responses, implying an easier identification with 
people, as well as a more stable inner life; (c) achievers appear 
more mature and adjusted in the emotional areas (this is re- 
vealed by their more frequent use of PC responses and lower 
frequency of anxiety and failure responses), and (d) good com- 
binatory wholes were more numerous for the achievers. This is 
frequently interpreted to indicate the presence of abstract and 
theoretical intelligence. It is to be understood, of course, that 
these group differentiae will not necessarily apply to particular 
individuals in the respective groups. 

Summary 

The Harrower Multiple Choice Rorschach Test was admin- 
istered to 158 probation and 93 non-probation students at the 
University of Georgia during the school year 1947-48, Pertinent 
findings were: 

i. A comparison of the two groups showed statistically sig- 
nificant differences in 24 of the 30 response groups of the 
Multiple Choice Rorschach Test . In 29 of the 30 response groups 
the differences favored the non-probation group. In 22 of the 30, 
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the differences were significant at the 1 per cent level of con- 
fidence; in two additional response groups, differences were sig- 
nificant at the 5 per cent level of confidence. 

2. A modification of the Harrower scheme for determining 
good and poor responses increased the discriminatory ability 
of the test. 

3. An item analysis of Multiple Choice Rorschach Test re- 
sponses of probation and non-probation students suggests the 
possibility of establishing, even more conclusively than do the 
present data, Rorschach patterns or signs which significantly 
differentiate between achievers and non -achievers. The fact 
that such differences in patterns exist would not in itself con- 
stitute sufficient evidence that a particular sign or pattern was 
causally related to achievement or non-achievement. 
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QUANTIFICATION OF THE WECHSLER-BELLEVUE 
VOCABULARY SUB-TEST 


WILSE B, WEBB 
Washington University 
and 

CHARLES HANER 
Grinnell College 

The importance of the role assumed by vocabulary tests in 
mental testing is unquestioned. Such tests have frequently 
been evaluated and often used as the best single index of gen- 
eral intelligence. Various statistical analyses have established 
the major role played by verbal factors. The appearance of the 
vocabulary test in a scale for the measurement of general in- 
telligence is almost a foregone conclusion. 

In addition to these more widely recognized facts the use of 
the vocabulary as a basal index in the study of mental deteri- 
oration and other aberrations has become increasingly appar- 
ent. Psychologists using the vocabulary test in this way in- 
clude Babcock (2), Capps (3), Schwartz (8), Davidson (4), 
Altman and Shakow (1), Simins (9), Rappaport (7) and others. 

In general, the problem of scoring these vocabulary tests 
has been treated somewhat like the weather — everyone talks 
about it and is affected by it, but little has been done about it. 
A surprising paucity of information or research on the scoring 
problems of such tests presently exists. 

Capps (3) pointed out the possibility of scoring errors in the 
present subjectively scored vocabulary tests, and used objec- 
tively scored vocabulary tests in the paper cited above. Yacor- 
zynski (13), in a theoretical paper, discussed the possibility 
of qualitative deterioration in word definition among deterio- 
rated patients which would be obscured by the gross scoring 
systems now employed. The implication was that deterioration 
ratios which use the vocabulary score as a basis for estimating 
deterioration may yield results which are a function of the 
scoring rather than of deterioration per se. 

693 
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A third major exception noted by the authors was that of 
Green (5). In an unpublished Master's thesis, directed by 
Terman, she clearly demonstrated the qualitative differences 
between various definitions given to vocabulary items, and sug- 
gested a scoring method based on a quantitative weighting 
system. Green administered the Vocabulary Test of the New 
Revision of the Stanfonl-Binet to a representative sample of 
7x8 subjects whose ages ranged from six to 84 years. Dividing 
the definitions into given response categories, c.g. , synonym 
unmodified, special meaning, effect produced, etc., and match- 
ing these against C. A,, Green was able to weight differentially 
the credit for each word on the basis of definition "typing.” 
This weighting could be applied reliably and was shown to 
differentiate clearly between C.A. levels below 18 years of age. 
Terman said, however, . .the method did not prove to be 
practical. ” (11). 

In general, the ability of the examiner to determine the 
quality of a definition and to determine its acceptability seems 
to have been taken as an innate "givenness” by most test con- 
structors and administrators. There is little doubt that the 
present vocabulary scoring does make use of a certain type of 
qualitative judgment. For the tVcchslcr-ReUevue '■Test the ad- 
ministrator is told: "The general rule is that any recognized 
meaning of the word is acceptable, elegance of language and 
precision being disregarded. ... poverty of content is penal- 
ized to some extent. When a subject seems to know vaguely 
what a word means his response is credited as only half right.” 
(ia). The following instructions are given to the administrator 
in scoring the Sian/ord-Rimt Vocabulary Test; "In general the 
more abstract and more difficult the word the more rigid the 
scoring requirements. . . . Awkwardness of expression is disre- 
garded.” (it). Both recommend further "questioning” of the 
subject if the examiner is in doubt. 

A point of departure for this paper might well be a state- 
ment made by Terman (10) in reference to his own vocabulary 
test (cited by Green in her paper), "We have not worked out a 
satisfactory method of scoring the quality of definitions in our 
vocabulary test, but these differences will be readily observed 
by the trained examiner.” Our question may well be: "Will 
they, and, if so, how will they be treated?” 
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This paper specifically concerns itself with the “Quality” ol 
the definitions of the Wechsler-Bellevue vocabulary words and 
the quantification of definitions of varying quality. Obviously 
there is a difference in the quality of such definitions of the 
vocabulary item orange as “eat it” and as “a nearly globose 
fruit, botanically a berry of an evergreen rutaceous tree.” 
The question arises as to what is the qualitative difference be- 
tween the definitions? Is one a “better” definition than the 
other, and, if so, how much better? Most important, there is 
the question of how such responses would be scored by differ- 
ent examiners if these qualitative differences were taken into 
account. 


Purpose 

The purposes of this paper are two-fold. First, an attempt 
has been made to determine the nature of judgments of the 
adequacy of typical definitions of the Wechsler-Bellevue vo- 
cabulary words by a fairly representative group of test admin- 
istrators. Considered are (a) the agreement expressed by test 
administrators in rating definitions alonga continuum of “good- 
ness of definition,” and (b) the extent to which different judges 
(test administrators) would rate a given definition as “accep- 
table” or “not acceptable ” Secondly, this paper attempts to 
determine the nature of the distribution of the ratings of a 
large number of representative vocabulary definitions. Con- 
sidered here are (a) the range of such definitions termed “ac- 
ceptable” and (b) the distribution of these “ acceptable” defi- 
nitions. 


Methodology 

The purposes of this study necessitated as wide a coverage 
of possible responses to the vocabulary words as practical. 
In an attempt to achieve this, 314 Wechsler-Bellevue case 
records were obtained from the Psychology Clinic at the State 
University of Iowa. These records were of tests administered 
by students in a clinical practicum course. Of these, 286 rec- 
ords yielded verbatim reports as reported by the test admin- 
istrators of responses to the vocabulary words. A survey of 
each record for the definition of each word was made and all 
“correct” responses (responses given credit by the test admin- 
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istrator) which differed in other than simple wording differ- 
ences, were listed. These were then examined by the authors 
for obvious overlapping. The final number of responses for 
each vocabulary item is listed below . 1 


Apple 


13 

Tint 

30 

Recede 

23 

Donkey 


21 

Armory 

18 

Affliction 

37 

Join 


36 

Fable 

• 9 

Pew ter 

10 

Diamond 


21 

Brim 

1.1 

Ballim 

18 

Nuisance 


23 

Guillotine 

as 

Catacomb 

23 

Fur _ 


28 

Plural 

16 

Spangle 

34 

Cushion 


36 

Seclude 

.11 

Espionage 

22 

Shilling 


11 

Nitroglycerine 

17 

Imminent 

20 

Gamble 


34 

Stanza 

aa 

Manm 

5 

Bacon 


21 

Microscope 

14 

liar a “Kiri 

14 

Nail 


34 

Vesper 

aa 

Chat tell 

r8 

Cedar 


13 

Belfry 

15 

Dilatory 

21 


Amanuensis 

7 

Aseptic 

*4 



Proselyte 


ti 

Flout 

19 



Moiety 


9 

Traduce 

3 



The use of actual case records, it was felt, would greatly re- 
duce the likelihood of omitting definitions apt to be found in 
administering the test. In addition an attempt was made to 
extend the coverage by providing a space on the rating forms 
in order that racers could include definitions which occurred 
to them or which they had received in giving the test. 

Certain limitations in this manner of selection of definitions 
should be noted. The population from which the items were 
selected showed a marked skew with a clustering around the 
higher IQ levels and one age group. The distributions were 
as follows : 


ivols of Selection Population 

Atftt Laval# of Selection Imputations 

IQ 

N 

Age 

N 

140-150 

14 

3o-over 

22 

130-139 

90 

28-29 

10 

X20-129 

114 

26-27 

2o 

110- 1 19 

57 

24-15 


100-109 

'i 

3 

12-23 

48 

OO- 99 

Bo~ 89 

20-21 

18-19 

3 

70- 79 

X 

16-17 

6 


1 5-bclow 

3 


It is recognized that this population bias may have limited 
the number of “poor” responses which would be found in a 


1 Specific definitions used, and the resultant median and Q values, may be obtained 
in mimeographed form from Dr, Webb, Department of Psychology, Washington Uni- 
versity, St, Louis, Mo, 
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population more widely distributed in regard to age and IQ. 
It is suggested that addition to the range would have only in- 
creased the number of “not acceptable” definitions and have 
had little effect on the range or distribution of “acceptable” 
definitions. This is supported by an informal survey of the few 
available children’s records from the Psychology Clinic which 
added no items not already listed in the basic survey. 

Another potential source of bias must be recognized. Some of 
the definitions were not verbatim and all were obtained in a 
“once removed” fashion, i.e., the responses were not neces- 
sarily the responses of the subject himself, but the recording of 
the response by the administrator. Thus, there is the possi- 
bility of bias, abbreviation or distortion. It is felt that this did 
not constitute an important source of bias since the responses 
on the scoring blanks were presumably those on which the 
scoring was done regardless of the exact response given. 

The definitions so selected were rated along a continuum of 
goodness by a group of test administrators similar to and in- 
cluding some of those who had given the test from which the 
definitions were taken. The rating population consisted of 40 
advanced students in psychology at the State University of 
Iowa. Of these, 36 were graduate students in psychology and 
four were seniors majoring in psychology. The majority of 
these students were in a clinical psychology curriculum. The 
following tabulation indicates the experience of the rating popu- 
lation in administering the Wechsler, 

Administered i-to tests 5 

Administered 10-50 tests 27 

Administered more than $o tests 8 

The scaling method used was a graphic one. A line was con- 
ceived of as a continuum of absolute goodness of definition. It 
constituted an n-point scale and the extremes of the con- 
tinuum were designated as o and io. These extremes were re- 
spectively described by the phrases “not acceptable” and “best 
possible.” The intervening portion of the line was divided into 
equal parts which were numbered i through 9, but with no 
written descriptions attached. 

Each vocabulary word was defined on the rating sheet be- 
fore the definitions to be rated were listed. These definitions 
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were taken from the Wechsler-Bellevue Manual and could be 
conceived of as “best possible’’ definitions. 

Since the Wechsler Vocabulary Test contains 4a words and 
each had a wide range of definitions to be rated, it was felt 
that fatigue and decreased motivation would be effective if the 
individual rater were required to rate all of the definitions. The 
list of vocabulary words was therefore divided into approxi- 
mately half so that one half of the rating population rated one 
list and the other half the other list. Thus, twenty ratings on 
each definition were available. To make possible a comparison 
of the two groups of raters, definitions of four “overlap” words 
were put in both forms of the rating sheets. Two sets of rating 
forms were constructed with approximately equal numbers of 
“hard” and “easy” words (determined by Wechsler-Bellevue 
scale position) in each, and approximately equal numbers of 
definitions to be rated. To further reduce fatigue and motiva- 
tion changes the raters were given several days to complete 
the ratings. 

In order to avoid a constant rater tendency to rate at one 
end of the scale, the scale was reversed for each definition to be 
rated. The two forms of the scale were distributed at random 
to the rating population, written instructions were attached 
and were supplemented by oral directions. 

Results 

Scale Falues . — Scale values were determined for each defini- 
tion by computing the median rating given that definition. 
It was arbitrarily decided in advance that any definition re- 
ceiving 50 per cent zero or "not acceptable” ratings by the 
judges would be considered “not acceptable,” If over 50 per 
cent of the judges rated a definition as “acceptable,” but some 
rated it as “not acceptable,” the median would be computed 
for those who rated it as “acceptable” and this value reduced 
by multiplying it by 100 per cent minus the per cent of the 
judges who rated it acceptable. Thus if 40 per cent of the judges 
assigned a definition a “not acceptable” rating, its value de- 
termined as the median rating of the other judges would be 
reduced by 40 per cent. 

Deviation of Ratings , — The quartile deviation (Q) was also 
determined for each definition rated. The Q value represents 
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the degree of rater agreement on the “goodness” of the defini- 
tion. The Q indicates (a) the degree of agreement among the 
raters; and (b) the confidence one can put in the scale values 
so obtained in using them to study deterioration or for other 
applications. It is recognized that the magnitude of the Q may 
be influenced by the scale value. When scale values fall at or 
near the extremes of the continuum, the spread of raters judg- 
ments cannot be as great as when the scale values fall in the 
middle of the continuum. 

Constant Errors . — Three raters were found consistently to 
underrate the goodness of the definitions in comparison with 


TABLE i 


Median and Quart tie Deviation Values oj Definitions Rated Twice by the Same Judges 


N “ 20 


Definition 


Affliction 

Something wrong with you 
Nuisance 
Annoyance 
Espionage 

Trying to find out what others are doing 
Catacomb 

Tombs under churches 
Gamble 

Play for money 
Seclude 
Isolate 


First Rating 
Md Q 


s-so 

1.38 

7-75 

•74 

2, $6 

■75 

4 60 

a. 10 

S-*J 

X .46 

y.yi 

.80 


Second Rating 
Md Q 

5 33 

1 .08 

7.50 

1.25 

334 

1 56 

4.28 

1.65 

5 54 

1. S 3 

7-93 

80 


other raters. Correction for these raters, following Guilford (6), 
was made by computing the median of the ratings without 
these judges' ratings included, then determining the deviation 
of each of his ratings from the median, summing the deviations 
algebraically to obtain a correction factor and applying the 
corrections’ factors to the respective ratings 

Reliability Three aspects of reliability are dealt with in 
this study: (a) the consistency of a single judge in rating and 
re-rating a given definition, (b) the agreement of two groups of 
judges in rating definitions, and (c) the agreement among a 
number of judges in rating a given definition along a continuum 
of goodness. This latter aspect involves the sub-problems of 
( 1 ) agreement of ratings of acceptable definitions and (a) agree- 
ment on the acceptability of a given definition. 

An attempt to deal with the first of these aspects of reliability 
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was made by including a few of the definitions twice in the 
rating sheets. This was done for six words which had a large 
number of definitions. One of the duplicate definitions was put 
near the beginning of the series of definitions, the other near the 
end, and on separate pages of the rating sheets whenever pos- 
sible. It was felt that the duplication would not be noticed, 
and reports of judges following the completion of their ratings 
testify to the correctness of the assumption. Table i presents 
the median values and Q‘s of the rating and re-rating of these 
duplicated definitions. The closeness of the medians would 
seem to suggest strongly individual rater reliability. This agree- 
ment may be spurious, however, due to the fact that a few 
raters may have "caught" one or more of the duplications. 

It will be recalled that two groups of raters were used in an 
effort to reduce fatigue and loss of motivation. Each group 
rated definitions of about half of the vocabulary words. This 
imposes the second problem of reliability, i.e., bow do these 
groups of judges agree on their ratings, and are stable quan- 
titative measures of goodness of definition obtained from groups 
of raters? To answer these questions, the definitions of four of 
the Wcchsler vocabulary words were included on both forms of 
the rating sheets. In Table a medians and £>'s of the ratings of 
the definitions of these four ''overlap" words by the two sets 
of judges are shown. 

It is seen that for the definitions of the word pewter, Group 
II tended to give higher ratings than did Group I, This tend- 
ency was also noted for the other vocabulary words, but is 
less pronounced. For Group I the “overlap" words were at the 
end of the rating sheet and for Group II about a third of the 
way through the list. The noted differences may indicate a 
lowering of ratings due to fatigue and/or group-rating differ- 
ences, In general, however, it is felt that Table i may be in- 
terpreted as indicating that relatively stable quantitative rat- 
ings of vocabulary definitions may be obtained by group ratings. 

The third aspect of rater agreement is that of the agreement 
of the judges in rating a given definition along the continuum 
of goodness. The statistical measure of the degree of agreement 
was the quartile deviation. Judgments were assumed to be 
rectangularly distributed within a scale-value interval (e.g., 
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TABLE 2 

Median and Qjiartilc Value oj the Two Groups oj Judges Rating the Four Ove? lapping 

Words 


N - 20 

Definition Number Group I Group II 

Md Q Md Q 


Pewter 


A 

4. JO 

2.00 

J.70 

I . IO 

B 

4 50 

2.50 

4 °7 

* 39 

C 

7,00 

2.25 

7.61 

.70 

D 

4.68 

1 '75 

6.19 

.89 

E 

3-75 

■ 34 

5 06 

>•55 

E 

4.50 

>■75 

5.50 

I 26 

G 

3-3° 

1.50 

4 58 

>•55 

H 

6 60 

>•75 

8.20 

I II 

I 

2.48 

I .OB 

4.2J 

1.42 

J 

»-4S 

1.67 

2 63 

> 58 

K 

4.04 

2 09 

5.63 

.96 

L 

4 34 

2.25 

6 .07 

I 19 

M 

1-94 

2.05 

2 25 

1.99 

N 

2.70 

1.34 

4.37 

I .6l 

O 

6.00 

2.1? 

6.7J 

2 II 

P 

a. 70 

I ,06 

2.83 

1.42 

Q 

4 50 

1-57 

5. 49 

i.ij 

R 

Not acceptable 

I 32 

I 98 

S 

4.00 

2.13 

5.45 

68 

T 

4,67 

1 50 

7 10 

I .30 

Ballast 

A 

3-49 

I .80 

4.72 

1 95 

B 

7- 12 

>•54 

8 12 

I-Sa 

C 

6. jo 

I. II 

6 63 

I. IS 

D 

7.21 

■97 

7 40 

I IO 

E 

4-44 

2.07 

6.12 

2 03 

F 

4.4J 

I ,20 

5 37 

1.99 

G 

3.50 

1.83 

5 37 

1 51 

H 

Not acceptable 

>■35 

1.38 

I 

8,70 

.92 

Vi 

I .OO 

T 

8.07 

i 57 

8. 06 

I .09 

k 

5-'8 

i.ij 

6,06 

.87 

L 

5-15 

>.8J 

5 70 

I OO 

M 

6.88 

1.55 

5 9° 

i 66 

N 

6.25 

1.6J 

5,10 

1.98 

O 

8 30 

I .OI 

8.7O 

88 

P 

8.08 

I 46 

8.12 

1 04 

Q 

8-73 

■91 

8.4J 

1. 12 

R 

7.50 

1 41 

7.21 

1 04 

Catacomb 

A 

4. Jo 

2.07 

0.15 


B 

9.0J 

.69 

9-3 6 

• 3 ° 

c 

S.SO 

I. 6l 

6.3O 

1. 17 

D 

2,22 

2.21 

2.21 

1 83 

E 

S' 84 

1.71 

7.2J 

1.49 

F 

2.43 

2. II 

4. Jo 

1 33 

G 

3*40 

>.8j 

3-49 

■ 53 
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to. 5J 
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.14 

.11 


4.00 to 4.99) and medians and Q’s computed accordingly. 
Therefore, even though all judges rated a given definition at 
the same point on the continuum, it would have a Q value of 
.15 (i.e., perfect agreement would be expressed by a Q of .25). 
This method of computation must be noted in evaluating the 
obtained medians and Q’s, 

Table 3 indicates the frequency of various magnitudes of 
Q’s obtained. The range of Q’s was from .28, indicating almost 
perfect agreement to 3.28, the largest amount of disagreement 
obtained. 

Interpretation as to "how good” the degree of rater agree- 
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menC obtained is, is made difficult by a lack of similar studies 
with which to compare these results. However, from an ex- 
amination of the ratings given, the definitions presented in 
Table 3, and from the preceding tabulation, it would seem 
that relatively poor agreement characterized these judgments 
of goodness. 

Even considering that perfect agreement is expressed by a 
Qof.25, it is seen that the median Q of all ratings is about 1 . 2 $, 
indicating that 50 per cent of the judges would rate a given 
definition within a spread of a.50 points or less on the 11-point 
scale, and that 50 per cent would rate beyond this value, for 
half of the definitions. For the other 50 per cent of the defini- 
tions the degree of rater agreement would be even less. While 
it is impossible to know from these results how well judges 
would agree in using a three-point scale, as "full credit,” "half 
credit,” and "zero credit,” it would seem that subjective scor- 
ing would lead to numerous discrepancies in scoring. 

Further evidence for questioning the accuracy of rater judg- 
ment is found if a second aspect of inter-rater agreement is 
examined; agreement as to the acceptability or non-accepta- 
bility of definitions The following tabulation shows the 
number of “not acceptable” ratings given definitions receiving 
various unweighted median values (total number of ratings 
per definition was 20). 


Unwcigli led Median 

Mean Number of 
"Nol Acceptable" 
Rating' f liven Each 
Definition 

RntltfC 

•OO- .99 

7 OO 

i. 00-1 .99 

5.88 

i.oo-i. 99 

3-56 

3.00-3,99 

2 39 

4.00-4,99 

1.63 

; 00-5.99 

6,00-6 99 

.81 

41 

9.00-9,99 

.08 


The above tabulation shows that as the median values in- 
crease the number of "not acceptable” ratings decreases, in- 
dicating a general form of agreement on the part of the raters 
as to thdr evaluation of the goodness of the definition. How- 
ever, it also points out the danger of subjective scoring of the 
vocabulary. The above tabulation may be interpreted as fob 
lows: When it is stated that twenty judges rated the defini- 
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tions, then definitions rated by 13 of the judges as acceptable, 
and given a median rating of .00 to .99, were rated “not ac- 
ceptable” (on the average's by seven raters. Likewise, s 8.3 judges 
found acceptable definitions which they rated between 4,00 
and 4.99) and 1.63 judges on the average found these defini- 
tions “not acceptable." It is noted that definitions which 95 
per cent of the judges rated halfway along the continuum of 
absolute goodness were rated “not acceptable” on the average 
by 5 per cent of the judges. 

Summarizing the results on the problem of inter-rater agree- 
ment it appears that on an 11 -point scale, agreement among 

TABLE 4 

Fntjuificy Ft unbutton oj Mid s an Fafut i &J Df/itiitioni 


Scale Interval 

Number 

— - 

I’er cent 

-- - .99 


*93 

J.OO-1 .99 


* ss 

i.txr a. 99 


iM 

3. 00-3.99 

9 * 

U - 9 > 

4. ocr-.» .99 

vx\ 

H.70 

e.oo~jr.t» 

140 

17.01 

6 . 00 - 6.99 

U6 

16. J9 

7.00-7.99 

139 

IJ.67 

8.00-8.99 

80 

9-71 

9.009 JO 

29 

3 S* 


raters as to the specific quality of a given definition is relatively 
low. In addition, a relatively low degree of agreement as to 
whether a given definition is an acceptable one or not was noted. 

Other problems of rater agreement requiring study are (a) 
rate re-rate agreement over a longer period of time than used in 
this study, (b) agreement of judges with disparate training and 
(c) agreement in using quantified scales once constructed. 

Distribution of Rated Definitions 

A description of the median values are presented in Table 4. 
There would seem to be a true qualitative range of definitions 
of Wechsler-Bellevue vocabulary words as judged by the rating 
population. By the rating method used, the highest score ob- 
tainable would have been 9.50. The highest median actually 
obtained was 9.4a, and ,45 was the lowest acceptable definition 
value obtained. In addition, a number of definitions were 
rated as "not acceptable.” 
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An internal examination of data seems to indicate that if the 
subject knew the difficult words at all he could give a good defi- 
nition of them, while subjects might “know at” easy words 
without being able to define them well. If this is so there would 
be a greater qualitative spread of definitions of easy words than 
hard ones. Evidence for this is seen in the standard deviations 
of the median values of the first and last few words. 


First Words 

Sigma of "Md values 
of definitions 

Apple 

3 . la 

Donkey 

3.06 

Join 

Diamond 

2 , 16 

2 03 

Fur % 

1.88 

Cushion 

3.68 

Shilling 

2 . 87 

La it words 

Dilatory 

1 .11 

Amanuensis 

1.36 

Proselyte 

1.56 

Moiety 

1.85 

Aseptic 

1 84 

Flout 

1. 85 

Traduce 

I 53 


A plot of tile distribution of the median values of the defini- 
tions of the first six vocabulary words is found to be nearly sym- 
metrical with a mean slightly above 5. The distribution of the 
median values of the definitions of the last six words is markedly 
negatively skewed with a mean slightly above 6.5. The distri- 
bution of median values of definitions for the entire vocabulary 
is found to be almost symmetrical, a very slight negative skew 
being manifest. The mean for this distribution is about 5.5. 
The range of the distribution of medians for the last six words 
is small, but the range of the distribution of medians for the 
first six words is almost as great as that for the entire vocabu- 
lary distribution. 

In all, the ratings suggest strongly that there exists a con- 
tinuum of goodness of definitions and the distribution of defi- 
nitions along this continuum is a symmetrical bell-shaped one. 
The range of this continuum is from near “not acceptable” 
to at or near “best possible.” To give either full credit or no 
credit, or in some cases half credit, to definitions which form a 
true continuum, and not discrete or bi-modal distributions, 
would seem to obscure valuable data and to distort the obtained 


measure. 
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Summary and Conclusions 

The data of this experiment suggest that there exists a con- 
tinuum of definition "goodness” which for the Weehsler scale 
is approximately normal. The existence of such a continuum 
seems to indicate that much valuable data are at the present 
obscured by the rather crude '‘intuitive" Scoring system pres- 
ently utilized. An examination of the problem of rater agree- 
ment indicates that the level of goodness may be consistently 
established by groups of raters. The consistency of an individual 
racing was demonstrated. The data, however, further indicated 
considerable inter-rater variability. These facts together lend 
themselves to the suggestion of the desirability of a more ob- 
jective scoring technique to reduce this individual variability. 
It was argued that the present system of rating does not meet 
this demand. 
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THE UNIT IN INTERVIEW ANALYSIS 

FRANCIS P. ROBINSON 
Ohio State University 

Research into the dynamic interactions between counselor 
and client is a matter of recent history. Porter (io), who was 
probably the first to use recordings of actual interviews in such 
research, used each separate counselor speech as his unit of 
analysis, i.e., the counselor’s remarks between two client 
speeches. Since single counselor or client speeches stand out 
structurally in a transcript of an interview, it seems quite 
logical that early approaches should have emphasized this unit 
in interview analysis. 

Succeeding studies continued to use the single speech or some 
variation of it as a unit while other aspects of the dynamics of 
interview sessions were explored. Thus Snyder (15) analyzed 
the relationship of single counselor remarks to immediately 
succeeding client responses. In this and other studies (1, 3, 5, 
ix, 12, 16), however, some difficulty was encountered in using 
all of the words between two speeches of the other participant 
as a unit because such speeches often seem to contain several 
independent ideas. So these studies explored using thought 
units, sentences, clauses and even instances of silence as units 
of analysis. Of related interest is the use of similar units in 
analyzing non-transcript material (6, 8). 

While these narrow units have produced quite useful research 
data, difficulty has frequently been encountered in their de- 
termination in actual interview analysis; each worker has usu- 
ally found it necessary to develop an elaborate Manual of 
Directions for adjudicating the many points of decision. In 
addition, these single speech units have had other shortcomings. 
Thus Snyder, in his study of the relationship of counselor re- 
marks to client responses, found it necessary to judge that each 
client idea in the immediate client speech was in response to 
every idea in the preceding counselor speech, when we know 

709 
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in fact that a particular client response may be to one part of 
the counselor’s remarks and not to another or may actually be 
in response to some previous speech or to some association of 
ideas within the client. Furthermore, it is difficult to use single 
speech units when studying the effectiveness of different types 
of counselor remarks. That is, it is difficult to judge reliably 
what is happening within a single speech, and while the client’s 
next response indicates his immediate reaction, it does not fur- 
nish evidence of later effects. Thus a client may at first resist 
a counselor suggestion but later accept it or treat it as his own 
idea. 

The entire interview is another obvious unit in analysis. 
An interview has meaningful structure in the minds of the coun- 
selor and client, and its beginning and end are clean cut. 
After reading an interview, judges can rate the general types 
of techniques used as well as the degree to which certain out- 
comes, e.g., rapport, insight, etc., arc present. The largeness of 
this unit, however, tends to prevent an analysis of the moment- 
to-rnoment dynamics within the interview. That is, over-all 
ratings can indicate the general counseling plan used and 
whether the interview was effective or ineffective, but this 
approach cannot very well get at the dynamics of how it 
happened. 

in an attempt both to increase the reliability of ratings and 
to get at the dynamics for entire interviews, various workers 
have tried classifying each remark during an interview and 
then using the average or the mode as the picture of the entire 
interview. While averaging many unreliable ratings of single 
remarks gives a more reliable picture of the pattern of tech- 
niques emphasized by a counselor, such a summation of 
immediate client responses does not provide a picture of the 
delayed effects of each counselor remark. Furthermore, an inter- 
view does not consist simply of a series of equivalent and there- 
fore addablc comments starting with “how-do-you-do” and 
ending with “good-bye”; there are episodes of small talk, of 
questioning the other for information, of making arrangements 
for next time, and, within the body of the interview, of dis- 
cussing various topics which have quite different dynamics. 

The importance of differentiating between different sections 
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of an interview is shown by an analysis of some data provided 
by Snyder on 48 interviews by six non-directive counselors 
(15). The writer combined Snyder’s data on the individual 
remarks of six counselors and their clients’ immediate responses; 
Chi Square and the Coefficient of Contingency were then com- 
puted for this master table. The Chi Square showed the dis- 
tribution of client responses following each type of counselor 
remark deviated from the expected distribution far beyond the 
I per cent level of significance; this simply corroborated 
Snyder’s findings on six separate tables for the six counselors. 
The degree of relationship existing is further indicated by com- 
puting the Coefficient of Contingency (interpreted similar to 
a correlation coefficient) for this distribution, i.e., .654. How- 
ever, an inspection of the 154 cell-square contingencies in the 
table showed that 79 per cent of the chi square which entered 
into computing this coefficient was contributed by only three 
cells' The list below of the cells with the largest cell-square 
contingencies clearly shows that the most important dynamic 
found by this analysis is that the presence of special situations 
in the body of the interview markedly changes the course of 
the interview. Individual remarks from such differing areas 
probably should not be summated: 


Counselor technique 

Client response 

Cell square 
contingencies 

Ending interview 
Friendly discussion 

Ending interview 

Friendly discussion 

2434-1 

1515.6 

Questions 

Answers to questions 

1066. 1 

Structuring 

Ask for advice or informa- 
tion 

126.9 

Unclassifiable 

Unclassifiable 

124.8 

Rejection 

Rejection 

83.0 

Clarification 

Acceptance of clarification 

77.6 

Questions 

Acceptance of clarification 

- 53 - 8 1 

Clarification 

Ending of interview 

-50.4 

Clarification 

Answer to question 

- 43 -° 

Approval 

Discussion of plans 

40.7 


The most obvious point in this list is the marked tendency 
of any special situation, e.g., ending interview, small talk, 
questioning, structuring speeches, and unclassifiable responses, 


1 A minus sign menns that the particular client response is opt to occur less often 
than would be expected when that particular counselor technique is used. 



yii EDUCATIONAL AST* PttVCHOtOCtCAL MEASUREMENT 

to cause reasonable client responses hut ones which differ from 
those normally made in the regular course of an interview. 
And for those techniques normally tried in the body of the 
interview, e.g., clarification, approval, interpretation, urging, 
etc., there is a tendency not to result in these special situation 
responses. Differential diene response . to different counselor 
techniques usually used in the core of an interview tend to he 
less significant than the effect of these special reload mis. Fur- 
ther evidence as to the existence of qualitatively different sit- 
uations within the interview will hr presented in a moment, 
but first let us complete our historical review of methods of 
interview analysis. 

Not only have single speeches and the interview been used as 
units, but the entire interview series with a client also stands 
as a logical unit. Thus one can compare what happens between 
the counselor and client with the outcomes of the interview 
series. This can he done either by overall ratings of the scries 
or by summation the individual counselor and client responses. 
The same criticism applies to using this latter method, however, 
as it was pointed out in discussing its use in the single inter- 
view. 

There has also been particular interest in analyzing the 
changes which take place during an interview series. Here each 
interview has been taken as a unit or, because interview series 
differ in length, they have been divided into tenths (9, n, 15). 
This latter method seems particularly subject to criticism since 
it obviously assumes that whatever is discussed within each 
tenth is comparable. That la, one tenth which happens to em- 
phasize small talk, making arrangements, structuring speeches 
and questioning cannot be compared to another tenth which 
emphasizes therapy problems. And it may be questioned 
whether tenths which emphasize therapy problems should be 
compared to other tenths which emphasize study skill counsel- 
ing or even vocational planning. 

Each of the units that have been discussed has its functions 
and, of course, its limitations, It is the purpose of this paper to 
call attention to another type of unit which also has its place 
for certain types of interview analysis. This unit is the division 
of interviews according to topics of discussion. While this unit 
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answers many of the objections made above, it also has its 
limitations. 

The unit is determined by having judges read an interview 
through and, whenever the major topic changes, make a mark. 
All of the material between these marks is treated as a unit. 
The analysis of Snyder’s results above indicated that special 
situations of ending interviews, friendly discussion, question- 
ing, and structuring speeches stand out as distinct sections 
within the interview. Furthermore, within the body of the 
interview, units would be marked off as the counselor or client 
shifts from a study skill problem to an emotional problem or 
a problem of vocational decision, etc. 

Sherman (14.) who first made a study of this type of unit 
found that they can be marked off as reliably as other units 
used in interview analysis. She found, for instance, that three 
judges reading a random sampling of interviews had a 95 per 
cent agreement as to the place of unit division. In the major 
instance where these judges disagreed, 

One judge had divided one unit into two parts at a point 
of slight interruption in the main flow of conversation which 
almost immediately turned back to the point of discussion 
before the interruption. This difference in division would 
probably have made little, if any, change in the final rating 
of the units. 

The discussion topic stands up as a unit on several bases. 
A client will have a particular attitude toward one topic and 
a different attitude toward another problem. While discussing 
any one topic, this attitude is apt to be maintained. Thus with 
an emotional problem, the client will feel hesitant to bring out 
much before the counselor, but with a study skill problem he 
will not have such hesitancy but will not know what is wrong 
with his skill. The counselor’s role also varies from topic to 
topic, but within a given topic his attitude and manner are 
apt to be fairly constant. Similarly, in carrying on small talk, 
making arrangements, questioning for information, etc., the 
client and counselor will play rather consistent roles while the 
topic is being discussed, but these roles shift as the topic shifts. 
In the discussion topic more than any other unit it seems 
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defensible to summate inflividu.il speeches because they all 
deal with a common .subject and are uttered with more or less 
constant attitudes on the pari of the participants. The most 
frequent or dominant technique used during the discussion 
topic can he called its "primary technique.” This modal coun- 
selor technique has greater reliability than does the rating of 
any single counselor speech, Furthermore, studies can he made 
of patterns of secondary techniques used in conjunction with 
the primary counselor technique. Ratings of outcome can be 
more reliably made from a scries of client speeches than from 
a single speech and the inclusion of all the client remarks dur- 
ing the unit enables a judge to determine if a counselor remark 
obtains some effect in succeeding remarks. And evidence of 
delayed results can be looked for when this particular topic 
recurs in later interviews. The discussion-topic unit also over- 
comes the objection made to dividing interview series into 
arbitrary proportions such as tenths. Dynamics during the 
interview series can be studied by comparing what happens 
when the same topic is discussed in succeeding interviews. 

Further evidence that interviews often show important 
changes in dynamics with a change in topic is indicated by the 
tendency for the primary counseling technique to shift with 
change of topic. An analysis of seventy-eight interviews in a 
student personnel program showed that almost all of the 439 
units emphasized one of four primary counseling techniques. 
These were, in order from the least to the greatest amount of 
leading: clarification, tentative analysis, interruption, and urg- 
ing. What tendency is there in these interviews, then, for the 
counselor’s primary technique to shift with a change in topic 
of discussion as compared to the variability which might be 
expected from the unreliability of this method of rating coun- 
selor method? Independent re-rating of the same units ten 
weeks apart (reliability) showed an 87 per cent agreement as to 
the primary technique used. On the other hand, pairs of units 
selected at random from within the same interview showed 
much less agreement. That is, these different units showed only 
43 per cent agreement and the deviations when they did occur 
averaged 1.44 steps on the four-point scale mentioned above, 
i.e., from clarification to urging. 
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While our discussion has emphasized the consistency of pat- 
tern of response within a discussion topic as compared to varia- 
tion with change of topic within the same interview, it should 
be noted that each discussion topic also tends to have a pat- 
tern of development. Thus Allen (i), making an analysis of 
166 discussion units in 0.9 interviews, found that the develop- 
ment of each unit tended to go through four stages: statement 
of the problem, elaboration as to the nature of the problem, 
making of plans, and (sometimes) a summary. All of these 
steps were not present in every unit and there was a consistent 
tendency for the later steps not to be as well developed as the 
earlier steps. She did find, however, that the most effective 
units tended to have these four stages present; there was a 
correlation of .71 between degree of development of stage one 
and stage two, and a correlation of .61 between degree of de- 
velopment of stage two and stage three. The fact that the 
effective units of “ non-directive” counselors aso showed such 
four-stage development probably indicates that the pattern 
is in great part due to processes within the client rather than 
to counselor structuring; on the other hand, units were some- 
times cut off in the middle when the counselor changed the 
subject to another topic he was thinking about. 

The discussion-topic unit lias been made the basis of a series 
of studies on interviews obtained in a student counseling pro- 
gram (13). In addition to the studies of Sherman (14) and Allen 
(1) mentioned above, Carnes (4) has studied the relationship 
of the amount of client talk to outcomes within discussion- 
topic units in the interview, and Elton (7) has studied the role 
of the division of responsibility between client and counselor 
in such units in the interview. 

Summary 

Various units, e.g., single speeches, whole interviews, tenths 
of an interview series, have been used in interview analyses. 
Eash of these has its advantages for certain research purposes, 
but each has particular shortcomings if used for other types of 
analysis, This paper has suggested that the topic of discussion 
within an interview affords another meaningful unit. Data have 
been presented justifying its use. 
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HOW VETERANS FEEL ABOUT VOCATIONAL 
ADVISEMENT 1 


STANFORD H. GLAZER 
and 

ARTHUR 0 ENGLAND 
Wayne University 

The Wayne University Guidance Center was established in 
October, 1945, as a part of the Educational Counseling Center, 
Division of Student Personnel, which was rendering vocational 
and educational counseling service to the student body. The 
program was instituted in conjunction with the Veterans Ad- 
ministration for the purpose of aiding veterans in the choice 
of their vocational goals. Guidance was available to all veterans 
who qualified under the provisions of Public Act Number 16, 
which provides for veterans with service-connected disabilities, 
and Public Law Number 346, which provides for those veterans 
who do not have a service-connected disability. From October 
11, 1945, until January 1, 1946, one hundred and fifty veterans 
were advised at the Center. In 1946, the first full year of opera- 
tion, the number rose to 1,720; in 1947, 1,589 veterans were 
counseled. These figures constitute only completed advisements 
under Public Act ft 16 or Public Law #346. 

Perusal of current research literature on Veterans Guidance 
Programs reveals only a limited amount of material dealing 
with the attitudes of the veterans toward the results of com- 
pleted advisement. Statistical analysis of goals selected, tests 
used, and training pursued are but one phase of the total guid- 
ance picture. The counselees’ feelings and attitudes toward 
their advisement are important criteria of guidance success 
which cannot be ignored. Recognition of this fact was acknowl- 
edged by the Rochester Center in their study appearing in 
97 /if American Psychologist, January, 1948 (2). 


'The writers wish to express their gratitude to Dr, Doris Cline, Director of Wayne 
University Educational Counseling Center, for making this study possible and for the 
many helpful aids that she gave us in its preparation. Also, we wish to acknowledge 
our Appreciation to the members of the staff for their many helpful commentaries. 

VI 
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Accordingly, an attitude survey was conducted by the 
Wayne University Guidance Center immediately upon comple- 
tion of ad' Foment. A Questionnaire was uiven to each veteran 
completing advisement by a person other than the counselor, 
and the veteran was requested to indicate his reactions toward 
counseling. The veteran had complete privacy, and the infor- 
mation was requested on a voluntary basis. There were no 
means of identifying the Questionnaire once it had been com- 
pleted. Since the results of this survey were so highly favorable, 
it was decided that a more valid picture of attitudes could be 
determined if sufficient time had elapsed for the veteran to 
evaluate the results of his advisement. Thus, to avoid this 
obvious “ halo effect,” a study of Public I .aw ft 346 cases which 
had been completed prior to March 1, 1947, was instigated. 
Two factors influenced the choice of studying Public I. aw # 346 
veterans, rather than Public Act # lf>. First, it was believed 
that such individuals would have greater latitude in their vo- 
cational selection, and secondly, there appeared to be less in- 
formation available cm Public Law *346 veterans. 

In the construction of the Questionnaire, objective data were 
necessary in order to evaluate more accurately the feelings and 
attitudes expressed by the veterans. Consequently, five ques- 
tions were devoted to factual data and the other four to the 
measurement of the feelings and altitudes of the counselee. 
Emphasis was placed upon evaluating the goals followed in 
training; the relationship between goals and training; the goals 
recommended as a result of advisement-, the level of progress 
attained in training; and whether or not training was leading 
toward the desired objective. Factors considered in the atti- 
tudal phase of the Questionnaire included testing, occupational 
information, techniques of counseling, and decisions reached as 
a result of counseling. 

The Questionnaire was mailed to 500 veterans who were se- 
lected by alphabetical sampling. The only stipulations for se- 
lection were that the veteran should have completed advise- 
ment prior to March 1 , 1947, and that he should have completed 
counseling, under provisions of Public Law #346. Six weeks 
were allowed for the return of the Questionnaire. One hundred 

and fortv-fnnr vntfrani rMnnnHorf irii»l4infr a fnrnl rf*rnrn nf 
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An investigation of the expressed goals of the one hundred 
and forty-four respondents showed that eight (5 5 per cent) 
were still undecided, and eleven (7.6 per cent) offered no com- 
ment. Fifty-two different occupations were stated as desired 
goals hy the respondents. Eight occupations were listed by five 
or more individuals with engineering, accounting, and teaching 
the most frequently named. 

In terms of the type of training being pursued, inspection of 
Table 1 shows that one hundred and seven veterans are pur- 


Tyi>e o( Truimtifi 

Demure . . 
Terminal 
No Training - • 
No Comment . . 


TABLE J 

Tiahiing Being Pursued 


Num- 

ber 



9 

2 


Total. . 


1 44 


TABLE 2 

Relationship cf Training and Desired Occupational Goal 


Lcfttlimt Terworri Num 

Occupational Coal bar 

Yes 109 

No n 

No Training 9 

No Comment , . 14 


Total 1 44 


suing training at the degree level; twenty-six at less than de- 
gree level; and two offered no comment. It was encouraging to 
note that only nine (6. a per cent) of the veterans responding 
had not followed a training program under Public Law #346. 
This figure is somewhat lower than that reported by Long and 
Hill (3) and by Brown (l) in their follow-up studies of veterans 
receiving advisement. However, it is desirable to point out 
that both of those studies included veterans falling under the 
jurisdiction of Public Act #16. 

In obtaining the attitude of the veterans toward the train- 
ing being pursued and its relationship toward their desired oc- 
cupational goal, it was found that one hundred and nine ( 75-7 
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per cent) were pursuing training leading toward their desired 
goals. Twelve (8.3 per cent) stated that their training was 
not leading toward their desired vocational goal; nine (6.1 per 
cent had never entered training; and fourteen (9,7 per cent) 
did not respond to this question. In an expanded study of the 
twelve negative responses it was found that six were taking 
training which at least was closely related to their stated goal. 
Because of the various training programs and their diver- 
sified marking systems, the level of grades was indicated in 
four different ways. In order to present the material visually 
and to make the statistics more meaningful, these marking 
systems were converted to the one system of A, B, C, D, and 
E, as shown in Table 3. 


TAIU.K 3 

GraJff Attar rttJ in Training 

Kum- 


Oa4«* 


A 

B.. 

C 

D. . 




63 

SS 

c 

E 





No Comment . 



• ■ • 



13 

Tot*! 

— 



J 44 


It was found that only five (3.5 per cent) were doing "D” 
level work or less; fifty-five (38,1 per cent) were performing at 
the "C” level; sixty-three (43.7 per cent) were doing “B” 
level work; and nine (6.1 per cent) were performing at the 
“A" level. While these figures appear objective, it is necessary 
to point out that they represent the veterans' own apraisal of 
their progress level in training and that no verification of this 
attainment was made by the writers. 

A separate analysis was made of individuals doing unsatis- 
factory work in their training programs or unsatisfactory work 
in terms of their stated vocational objective. The latter is il- 
lustrated by a pre-medical student doing "C” level work which 
Would be insufficient to meet the minimum standards for ac- 
ceptance into the professional school. It was found that seven- 
teen persons fell in this category. Of the seventeen, ten were 
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following training in objectives not reached in advisement; 
five were training in objectives reached in counseling; and two 
were working in objectives reached as a result of the counseling 
program with the qualification that remedial work was indi- 
cated as a pre-requisite for successful completion of their course 
of study. 

In the tabulation of this question dealing with the relation- 
ship between training and decisions reached during counseling, 
it was found that fifty-three (36.8 percent) responded favorably 
to the relationship between training and counseling decisions; 
sixty-nine (47-9 per cent) felt negatively towards their train- 
ing program and the counseling decisions; nine offered a favor- 

TABLE 4 

Relationship ftttvcun Training and Decisions Reached During Counseling 
Training Fwllowctl O'* a 

j’cMji i til Iteiirmi 
Re;-. ‘..(I I Kirin- 

Yea . , . . . ...... 

No 

Parti ally , 

No Comment 

" Total . . ... 


Num- 

ber 



9 
1 3 


>44 


able response with qualifications; and thirteen offered no com- 
ment. A study of the sixty-nine negative responses from factual 
data available in case files revealed some discrepancy. Figures 
based upon the case records showed that twenty-seven of the 
sixty-nine are definitely following objectives that were reached 
in advisement; four are following objectives closely related to 
those reached tn counseling; five are pursuing training in an 
area which was one of the four objectives considered in the 
advisement; and one person was following training in an ob- 
jective which was closely related to one of the four reached in 
advisement. In nine cases there were insufficient data to draw 
any valid conclusions, and in twenty-three instances there was 
no correlation between present training objectives and the 
recommended objectives. 

A further breakdown of the twenty-three cases where there 
was no apparent correlation between training and objectives 
reached In counseling indicated that sixteen of the individuals 
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were doing successful work; six were doing unsatisfactory work 
in terms of their stated objective; one case was referred for 
mental hygiene tieatment. 

It was interesting to note the large numbers who expressed 
at least partial satisfaction with the decisions reached dming 
counseling. One hundred and twenty-seven veterans (88. a per 
cent) out of the one hundred and forty-four studied expressed 
either full or partial satisfaction with the decisions reached. 
Eleven (7.6 per cent) stated that they were not satisfied, and 

TABLE s 

Counselees' Attitude Toward Dcemnnl Readied During Counseling 

Num- 

I'-tprci-cr] F> d i n ;i f, ber 

Decisions were very satisfactory . 60 

Decisions were partially satisfactory . . . 67 

Decisions were unsatisfactory ... . . . . . ... 1 1 

No comment . .... ..... 6 

Total .... . . M4 


TABLE 6 

Counselee j' Altitude Toward Knowledge r>/ Their Ahihlits, Aptitudes , and Skills as a 

“ ‘ tJC 


Remit tj Counseling 


Had a Clearer 
Picture 

yIw.V. “ .' .7 

No 

No comment 


Num- 

ber 

ioa 

3S 

7 


Total 


144 


six (4.1 per cent) offered no comment. An investigation of the 
eleven cases who expressed dissatisfaction over the decisions 
reached, failed to reveal any significant reasons for their lack 
of satisfaction. Because the question is so highly subjective, 
the writers felt that caution should be exercised in commenting 
on this question, lest the interpretations express their view- 
points rather than those of the respondents. 

In responding to this question, one hundred and two indi- 
viduals (70.8 per cent) felt that they had a clearer insight into 
their abilities, aptitudes, and skills as a result of advisement; 
seven (4.9 per cent) offered no opinions, and thirty-five per- 
sons (24.3 per cent) stated that they did not have a clearer 
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picture as a result of the guidance offered. Case-history study 
of the thirty-five who felt they did not have a clear picture re- 
vealed that sixteen were in training as a result of objectives 
reached during counseling; thirteen were not following the 
agreed objectives; one person was following a closely related 
objective; one individual was taking training in one of the four 
discussed objectives; two had not reached any decision at the 
time of advisement; and in two cases there were insufficient 
data to arrive at any valid conclusion. Of this same group, five 
were referred for mental hygiene treatment. Also, only two of 
this group were attaining “D” level work, or less, in their train- 
ing program according to their answers on the Questionnaire. 

TABLE 7 

Coumeteet' Altitude Toward Occupational Information 


E*pretftcil Kecltnga 

Completely UndcTMood 
Partially UndctMoml . 

Not Understood at All 
No Comment . . 

Total 14+ 

In an effort to detect any possible relationship between men- 
tal-ability level and the understanding of one’s own aptitudes, 
abilities, and skills, a detailed study was made from the case 
histories of the thirty-five individuals who felt they did not 
have a clearer picture of their own abilities as a result of coun- 
seling. In each case the mental- ability score on either the 
Ohio State Psychological Examination, California Short Form 
Fat of Mental Maturity or the Otis Self -Administering Test 
of Mental Ability were recorded. Comparable college norms 
were used throughout. Twenty-two of the thirty-five individ- 
uals obtained mental-ability test scores in the 70th percentile 
or above. It appeared that a lack of mental ability was not a 
determining factor in the counselces’ ability to gain a clearer 
picture of their aptitude, ability, and skill as a result of the 
counseling situation. 

No additional analysis was attempted on the question of the 
counselees' attitude toward occupational information obtained 
from the counselors other than a tabulation of responses as 


Num- 

ber 


• 35 

It 

■ 19 
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shown in Table 7. It is felt that the figures represent an in- 
teresting commentary on the veterans’ attitudes toward occu- 
pational information made available during the counseling situ- 
ation. This point is expanded in the Recommendations and 
Conclusions section of this study. 

Recommendations and Conclusions 

As a result of the study it is felt that a clearer picture of the 
veterans' reaction to advisement has been established. Cer- 
tain areas of weakness can be detected, but in the main it 
would appear that the program has been satisfactory and help- 
ful in aiding veterans to select and to approach their vocational 
goals. More emphasis should be placed on improving vocational 
and job information. Literature which stipulates trends, op- 
portunities, and salaries in any specific objective or job at best 
may be accepted as a general index. Information which applies 
nationally may not reveal a true picture of the local scene. One 
must predict future trends with qualifications, and place emph- 
asis on variabilities which may affect drastic change. 

It appears that a high percentage of the counselees are fol- 
lowing successfully the objective reached at the Wayne Uni- 
versity Guidance Center, The over-all picture is highly encour- 
aging and establishes the program as being favorable. The 
reluctance of some Veterans to credit the advisement might be 
indicative of some hostility toward the counseling situation. 
There is a need for further follow-up study in this area to bring 
to light the basic reasons for this attitude, and such obtained 
information should prove helpful in further counseling ser- 
vices. 

Another factor that should be emphasized is the large per- 
centage of veterans who take advantage of training. The ma- 
jority are pursuing training at the degree level, and the most 
popular categories of training are those leading toward a defi- 
nite profession, 

One cannot ignore the many pertinent comments that were 
included in the replies. No attempt was made to tabulate or 
classify the numerous favorable remarks. An analysis of the 
more negative ones again stressed the need for greater occupa- 
tional information. Sixteen individuals stated that the serv- 
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ices could be improved in this area. Of at least equal impor- 
tance were the comments of eighteen persons who implied that 
more time could be spent in the entire advisement proceduie 
The urgency of the program and the numbers processed in 
1946 and 1947 are felt to be, in part, the answer for the ex- 
pression of dissatisfaction. As the quantitative needs diminish 
it is hoped that greater time can be spent on individual prob- 
lems. 

The reasons for requesting advisement may be taken as a 
testimonial to the seriousness and sincerity with which the 
veterans approached the guidance program. In only three in- 
stances was advisement taken as a resultof a forced situation or 
because of curiosity. Chief reasons given for the request were 
selection of curriculum (15 persons); selection of an occupation 
(39 persons); determination of abilities fora specific curricu- 
lum (10 persons); and appraisal of abilities (37 persons). 

As the program passes into its third full year of operation, 
it would appear that every consideration should be given for 
its growth and encouragement Changes should be recognized 
so that areas of weakness may be strengthened. Certainly no 
program dealing with individuals and their problems can be 
measured in terms of perfection, but rather on the basis of 
continuing improvement of services. 

Finally, it should be noted that this study is representative 
of only a small cross-section of the total number of veterans 
advised. It is fck by the writers that it constitutes a fair samp- 
ling, but the gross returns would impose limitations upon the 
conclusions reached. No complete analysis could be accom- 
plished without contacting and compiling data on each vet- 
eran who completed advisement at the center, 

REFERENCES 

t. Brown, M, T. “The Veterans Report Two Years Later.” Occupa- 
lions, XXVI (1948), 364-366. 

2. Lipsett, L, and Smith, L. F. "The Rochester Veterans’ Guidance 

Center Takes Stock." American Psychologist, III (1948), 12- 

3. Long, L, and Hill, J. “A Follow-Up Study of Veterans Receiving 

Vocational Advisement." "Journal oj Consulting Psychology, 
XI (1947), 88-92. 




A METHODOLOGICAL ANALYSIS OF THE 
INCONSISTENCY OF RESPONSE TO 
TEST ITEMS 


ROBERT GLASER' 

Indiana University 

While the consistency of psychological test scores in terms 
of reliability has been extensively studied, little research has 
been concerned with the consistency of response to separate 
test items. Consistency in the latter sense means responding 
to an item in the same way on different administrations of a 
test. Consideration of this factor raises certain questions Can 
a test result for an extremely inconsistent individual be inter- 
preted in the same way as a test score for an individual whose 
responses arc consistent? Is a person who is inconsistent on one 
kind of test inconsistent on other tests? What personal be- 
havioral factors and factors of the test situation influence in- 
consistency of response? If certain individuals are usually in- 
consistent and if this behavior is a function of certain known 
factors, may not this be of significance in test construction and 
interpretation? With such an orientation the writer set out to 
investigate the relationship of inconsistency of response to other 
behavioral factors. Previous studies indicated that consistency 
was related to intelligence and personality. The results of the 
present study led to conclusions which questioned the inter- 
pretations of the previous investigations on methodological 
grounds. 

Literature 

Three previous studies are directly pertinent to the present 
problem. Lentz (a) gave a conservatism questionnaire of aoo 
items to 57 students. The items consisted of statements of 

'The writer wishes it) acknowledge his gratitude to Prof, D. G. Ellson who con- 
tributed many valuable suggestions in the course of the development or the analysis 
herein presented. 
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opinion with which the subject agreed or disagreed. The Bern- 
r cut cr Personality Inventory was also given to 139 students. 
The tests were each given twice with approximately one month 
between the two administrations. Concerning personality and 
intelligence factors, Lentz reports an r of —.34, obtained be- 
tween the conservatism change score, i e., the number of 
changes in response front test to retest, and the Otis Intelligence 
’Test. The latter correlated with the Personality Inventory 
change score yielded an r of —.to. The conservatism question- 
naire change score showed an r of —.28 with the Personality 
Inventory introversion score and an r of. 14 with the conserva- 
tism score. The Personality Inventory change score showed 
coefficients of —.26 with the Inventory dominance score, .14 
with the neuroticism score, .12 with the introversion score and 
— .08 with the self-sufficiency score. A correlation of .51 was 
found between the conservatism change score and the prox- 
imity of the conservatism questionnaire total score to too, 
i.e., the score one would most likely get by chance. Concerning 
this latter correlation the author writes, 

Reasoning further wc would say that whatever caused one's 
score to approach the chance amount also caused the number of 
changes to increase. Speaking somewhat more speculatively, 
we might say that the persons making the higher change scores 
are more indifferent to the test, lack appreciation of or sym- 
pathy with the objective method in this field, have less of 
the social scientific attitude, are less sincere while taking 
the test. 

I-entz concludes that, ’’All told our effort to approach the 
causes and cures of changes via the correlations of change 
scores has not been very successful.” 

Neprash (3) gave the 'Thur stone Personality Schedule to three 
groups of students (total N = 67) and retested them with in- 
tervals of two, four and eight weeks respectively. Correlations 
ranging from .40 to .60 were rejiorted between the subjects’ 
neurotic scores on the test and their number of changes of re- 
sponse. Blxcluded from the number of changes were changes 
to or from a "?” response. The author writes, 

As for the subjects themselves some indication was found 
that the responses of the less well-adjusted subjects tended 
to be more unreliable than those of the better-adjusted. . , . 

On their face the data do not show which is cause and which 
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is effect, but it may not be at all improbable that the high 
relationship found between unreliability and incidence of 
neurotic responses to items may be a consequence of the 
lesser stability of the neurotic subjects indicated by the 
coefficients of correlation cited It would appear, however, that 
the resubmisMun of the schedule after some time has elapsed 
might be an additional aid in the identification of maladjusted 
subjects, if due regard were paid to the number of changes in 
response. 

Pintncr anti Fnrlano (5) gave the Aspects of Personality In- 
ventory to loo fifth-grade children. The test is a questionnaire 
of 105 scared items. F.aeh item requires the child to read a state- 
ment and then mark himself as ''same” or “different.” The 
test is divided into three subtests; an ascendence-submission 
test, an extrovert-introvert test, and a test of emotional sta- 
bility. The Inventory was administered to the subjects four 
times with a two week interval between test periods. A con- 
sistency of response score which consisted of the number of 
Items answered the same way on the last three administra- 
tions as on the first administration of the test was determined 
for each subject on each subtest. The correlations ot the con- 
sistency scores with the test scores (the average of the four 
trials) was r * —.03 for the ascendence-submission test, r » 

.09 for the extrovert introvert test, and r « .36 for the emo- 
tional stability test. Concerning these correlation coefficients 
the authors write. 

Evidently avccruient-ntbmiwive responses or extrovert-intro- 
vert responses are not differentiated by greater or less degrees 
of consistency. The auhmivdve child i* just as likely to be con- 
sistent (or inconsistent) as is the ascendent child; and likewise 
for the introvert and extrovert. The correlation of .16 for 
the E* test would scent to indicate a slight tendency for the 
more emotionally stable child to be slightly more consistent 
in his responses on the E test than the less emotionally stable 
child. The correlation is not high but it is high enough to 
suggest that a tendency in this direction exists. 

In summary, it is to be punted out for future reference that 
for the most part the correlation coefficients reported in the 
above studies were obtained by correlating the inconsistency 
or consistency scores of a test with die total scores of the same 
test. 


* Emotional uabtUty. 
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Procedure 

In the present study three psychological tests were admin- 
istered to a group of 1”9 college students. One month later the 
same tests were rcadministcrcd to the same group. The final 
number of subjects for whom complete data were obtained was 
135, 62 men and 73 women. Failure to take either the initial 
test or the retest accounted for practically all of the lost 44 
subjects. 

The number ofitems on which a subject changed his response 
was totaled and called an "inconsistency score." The tests used 
were an intelligence test, the Personnel ' lest (4), (an adaptation 
of the Otis Self Administering Test of Mental Ability) , the 
California Test of Personality (i) and the Occupational Interest 
Inventory (b) , (a preference type test in which the subject has 
to choose between one of two choices offered in a test item). 
For the intelligence test an inconsistency score was determined 
by counting the number of items which a subject answered 
correctly on the first administration of the test but incorrectly 
on the second or incorrectly the first time he took the test and 
correctly the second time. A change from one incorrect answer 
to another incorrect one was not counted as part of the in- 
consistency score. (If the latter was included, the intelligence 
test inconsistency score would be confused with guessing.) 
For the personality test an inconsistency score was determined 
by counting the number of changes from "yes" to “no” or 
vice versa from test to retest. The interest inventory inconsis- 
tency was determined by counting the number of changes in 
the choice of an. item from test to retest. However, since a 
change in one part of an item also meant a change in the other 
part of the item, the interest inventory inconsistency score 
was twice as large as an intelligence or personality test incon- 
sistency score of the same magnitude, i.c., indicating the same 
number of changes. The interest inventory inconsistency score 
was divided by two in order to make it comparable with the 
inconsistency scores of the other tests. 

Results 

The mean inconsistency scores and the mean per cent of 
items changed for each test are presented in Table 1, The mean 
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per cent of items changed on the different tests indicated no 
statistically significant differences between the amount of in- 
consistency on the tests. The correlation coefficients shown in 
Table 2 indicate that inconsistency of response on the different 
tests was not highly related. Two of the coefficients are statis- 
tically significant for the size of the experimental sample at 
approximately the 3 per cent level of confidence. 

The inconsistency scores on the three tests were averaged to 
obtain an average inconsistency score for each individual. A 

TABLE 1 


Inecniistency 0/ Response an Different Type Tens 


No of 

Teal Items 

Inconsistency 

Score 

.Me nri S D. 

Mean % 
of Items 
Changed 

Intelligence Test 50 

Perwmality Te .1 1S0 

Interest Inventory lia pairs 

6.06 3,62 

28.3a 9.96 
is 74 7.15 

12.!% 
15 - 7 % 
is 6% 

TABLE 2 

The Intercarreiahnns aj the Inconsistency Scares 0/ Different Type Tests 

T 

intclliaeme Test vs Interest Inventory . 
Intelligent c 'leu vs l’cr t,njlity Test ., , 
Intcrc.i Inventory vs Personality Test . 

...... . 2o 



weighted average was computed equalizing the contribution of 
the three inconsistency scores. In order to determine the rela- 
tionship of inconsistency to other behavioral measures the 
personality test adjustment scores and the intelligence test 
scores were correlated with the average inconsistency scores, 
yielding coefficients of —.36 and —.48 respectively. These cor- 
relations appeared to indicate that those individuals who re- 
ceived the lowest inconsistency scores, i.e., who were the most 
consistent, had the highest adjustment scores and the highest 
intelligence scores. However, it seemed possible that there might 
be a relationship between inconsistency of response on a test 
and the score on the same test, which would tend to make the 
above correlation coefficients spuriously high. In order to elim- 
inate this, the same test inconsistency scores were excluded 
from the correlations of test scores with inconsistency score. 
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When this was done the correlation of intelligence score with 
the weighted average inconsistency score of the Personality 
Test and Interest Inventory dropped to —.14-, the correlation 
of adjustment score with the weighted averaged inconsistency 
scores of the Intelligence Test and the Interest Inventory 
dropped to "-.04. Both of the latter correlation coefficients are 
not statistically significant. With the same test excluded from 
the correlation then, intelligence and personality test scores 
showed little relationship to inconsistency of response. Further- 
more a high degree of relationship between the inconsistency 
on a test and scare on the same test was indicated by a correla- 


TABLE 3 

The Correlation (r) rj Inanttffentjr Siam t nth Tut Seem 


Intelligence Tent Sente 

Personality T<at Scan (Adjustment 
Score) . 


AVc»j6jt (a 

#<• Jnr iht 

1 Te»U 

MA+itni'v fsr«*n 
Im 2 friB 
Omitting jiauMB- 
Twi 

&a.fne Tcil 
tnconjfcl«iU>ftcy 
Store 


-•U 

-.74 


~ «4 
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don of —.74 between intelligence test inconsistency score and 
intelligence test score and by a correlation of --.44 between 
personality test inconsistency score and adjustment score. The 
data in the above paragraph arc presented in Table 3, 

Discussion 

When the data of the present study were treated in the 
manner primarily employed by previous studies, i.e., correlating 
a test score with a measure of inconsistency which was derived 
from the same test to determine the behavioral correlates of 
inconsistency, similar results were obtained, i.e., inconsistency 
appeared to be related to intelligence and personality measures. 
However, it was found that when same-test inconsistency was 
omitted, when a test score was correlated with a measure of 
inconsistency obtained from other tests than itself, the rela- 
tionship disappeared. The results suggest that the relationship 
between inconsistency score on a given test and total test score 
on the same test may be a spurious one. How could this rela- 
tionship be produced? 
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The answer to the above question requires an analysis and 
interpretation of the nature of tests as measuring instruments. 

In psychophysical measurement as the discrimination of a 
stimulus becomes more difficult, i.e., as the individual’s thres- 
hold is approached from either direction on the scale of measure- 
ment, his responses become less consistent. The threshold is 
defined as the point of greatest inconsistency of response. Psy- 
chological test items like the stimuli of psychophysical experi- 
ments can he considered as falling on a scale of difficulty of 
discrimination in the sense that some items are more or less 
difficult to make responses to than others. It is to be noted that 
"difficulty of response” as here used is not the same as the 
difficulty of an item corresponding to its scale position (the per 
cent of a group passing or failing it). An item may be very diffi- 
cult in this latter sense but easy to respond to incorrectly or in 
a certain direction because it is far above the individual’s 
threshold. 

If test items are so considered it can be demonstrated that a 
spurious correlation between inconsistency and test score will 
result under certain conditions even when there is no true corre- 
lation between consistency and test score. Furthermore, as shall 
be indicated, it is possible to predict the size and sign of the 
correlation coefficient. 

I.et us assume a hypothetical test with (i) a rectangular 
distribution of items on a particular scale of measurement (as 
intelligence or a personality trait) and (a) a scale range ade- 
quate for the group being tested, i.e., items ranging from those 
which every subject passes to those which no subject passes. 
On such a test let us assume that a subject has a particular set 
of items at his threshold. At this point the difficulty of making a 
response would be maximum for him and he would exhibit a 
maximum inconsistency of response. As he responded to items 
which departed from the threshold in either direction his re- 
sponses to them would be less and less inconsistent. 

If we now consider three subjects who have different thresh- 
olds, the distribution of their inconsistency of response to the 
test items would be as shown in Figure I. For subject A most 
items would be above his threshold and most of his responses 
would be consistently incorrect (or in a certain direction). 
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Subject B would have approximately an equal number of items 
above and below his threshold and he would tend to answer 
50 per cent of the test items in one direction and 50 per cent 
in the other direction. For subject C most items would be below 
his threshold and he would answer them consistently right. 

From Figure I it can he seen that for the situation assumed, 
while the three subjects have different test scores their amount 
of inconsistency of response is the. same. Consequently, there 
will be no correlation between amount of inconsistency and 
test score. 

THE DISTRIBUTION OF INCONSISTENT RESPONSES FOR THREE 
SUBJECTS WITH DIFFERENT THRESHOLDS 



t*w in vrr** oa 


figure 1 

Now let us assume another test, one in which the range of 
the test is inadequate for the group being tested. The scale 
would then be cut off, for example, at a point y as shown in 
Figure I. In this situation, subject C would not be able to ex- 
hibit as much inconsistency as either of the other two subjects. 
As subject C has the highest test score this would result in a 
negative correlation between inconsistency and test score. If 
the test range was cut off at point x there would be a positive 
correlation between inconsistency and test score. If the scale 
was cut off at both x and y there would be a zero product- 
moment correlation. In the latter situation there would be a 
curvilinear relationship which would he indicated by a correla- 
tion ratio (eta) as inconsistency would be low for both sub- 
jects A and C and high for subject B. 

Applying the above situations to specific kinds of psychologi- 
cal tests it follows that on a hypothetical (as defined) intelli- 
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gence test, all subjects would be equally inconsistent and no 
correlation would be found between inconsistency and iitelli- 
gence score. If, however, the test was given to a group of bright 
or dull individuals for which it was of inadequate range, i.e. 
the scale of measurement was cut off at either the high or the 
low end, the nearer the threshold of an individual to the ex- 
tremes of the scale the less would be his inconsistency. For the 
individuals in the bright group the nearer their thresholds to 
the high end of the scale, i.e., the higher their test scores, the 
lower their inconsistency scores (negative correlation). For the 
dull group subjects the lower their test scores, the lower their 
inconsistency scores (positive correlation). If the two groups 
were combined, the scale of measurement would be cut off at 
both ends and the correlation (r) between intelligence score and 
inconsistency score would tend toward zero but a curvilinear 
correlation would be indicated, These same relationships would 
hold for a personality test given to a group for which it was of 
adequate range and also to well-adjusted and poorly-adjusted 
groups for which its scale of measurement was of inadequate 
range. 

In the light of the analysis of psychological tests here pre- 
sented certain hypotheses can he made (assuming no true rela- 
tionship between inconsistency and test score): 

Hypothesis 1 : If the range of die scale of measurement of a 
test is adequate for a group being tested, the correlation (r) 
between inconsistency scores and total test score will be zero. 

Hypothesis II : If the scale of measurement of a test is cut off 
at the upper end of the scale for a group being tested, the cor- 
relation (r) between inconsistency score and total test score will 
be in a negative direction. The size of the coefficient will in- 
crease as the mean score of the group approaches the highest 
score obtainable for the test concerned. 

Hypothesis III : If the scale of measurement of a test is cut 
off at the lower end of the scale for a group being tested, the 
correlation (r> between inconsistency score and total test score 
will he in u positive direction. 'I he size of the coefficient will in- 
crease an the mean score of the group approaches the lowest 
scores obtainable for the test concerned. 

Hypothesis IV: If the scale of measurement of a test is cut 
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off at both the upper and lower ends of the scale for a group 
being tested, the *orrr)a»i»>n (r) between inconsistency score and 
total test score will tend toward zero. As the distribution of 
total te*t scores approaches symmetry, i e. as the number of 
individuals with scores toward either extreme become equal, 
the product moment r<*cfJh lent will approach zero. (As the 
scale of measurement becomes ■■mailer. i.e., as more of the scale 
is cut off at the end*, the t omdatsojj ratio (eta) becomes larger.) 

The results obtained from the present study could have been 
expected on the basis of I I) puthrsis 11 . The study yielded a 
correlation of --.74 between intelligence test inconsistency 
score and intelligent e test score. Inspection of the distribu- 
tion of test scores showed that f-c, per cent of the subjects got 
at least $0 per cent of the items 1 or ret t and c/5.5 jx-r cent of the 
subjects got at least fc per tent of dm arms correct. For this 
group the scale of measurement was cut off at the upper end 
of the scale and the correlation between inconsistency score 
and test score is high ami negative as expected from Hy|w»thesis 
II. 

The correlation between personality test inconsistency score 
and adjustment score was -".44. Sixteen prr cent of the sub- 
jects answered at least He, per cent of the items in the adjusted 
direction and **4 per cent of the subjects answered at least 60 
per cent of the items in the adjusted direction. Again for this 
group the scale of measurement is cut off at the upper end. 
Hence, according to Hypothesis II the negative relationship is 
to be expected. Since more subjects pot near ■perfect intelli- 
gence scores than near-perfect adjustment scores, it follows 
on the basis of Hypothesis II that the higher correlation should 
have been obtained on the intelligence test. 

How do the results of previous studies fit into the scheme 
here developed? If we assume that the tests employed in pre- 
vious studies were not like our hypothetical test, then the hy- 
potheses concerning tests with inadequate scale ranges are 
applicable in the following instances. Lentz, (2) obtained a cor- 
relation of .51 between inconsistency of response to test items 
and a measure of tire proximity of the test score to the score 
which would have been obtained by chance alone. A chance 
score (50 per cent of the items answered in one direction) would 
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be obtained by individuals whose thresholds are at the middle 
of the test scale. As has been indicated those individuals with 
thresholds in the middle of the scale (like subject B in Figure 
I) are able tn show more inconsistency of response than in- 
dividuals with scores toward the extremes of the scale of meas- 
urement. The latter persons arc not able to exhibit as much 
inconsistency as the individuals with middle scores because for 
them the scale is cut off. 

Neprash (3) reported a mean score of 46.3 on the ‘Thurstone 
Personality Schedule for the subjects in his study. Since a score 
of 111 would be obtained by answering half of the test items 
in a neurotic direction, the group mean was well toward the 
low end of the test scale. Hence, on the basis of Hypothesis 
HI, the coefficients of .40 and .60 Neprash reported when 
neurotic scores (the test scores) and the number of changed 
responses were correlated are expectedly high and positive. 
In this Study a correlation of ,76 was reported between the 
frequency of neurotic responses to an item and the inconsis- 
tency of response to it. This is in accordance with the present 
interpretation of rests. The group mean was toward the low 
end of the scale; thus, the items toward the low end were an- 
swered more in the neurotic direction than were items at the 
high end. As the. items progressed toward the higher end and 
away from the group threshold, they would be answered with 
a decreasing number of responses in the neurotic direction. 
Consequently, a high positive correlation would result between 
frequency of neurotic responses to an item and the inconsis- 
tency of response to it. 

The mean test scores for the four administrations of the 
Aspects 0/ Personality Inventory in the Pintner and Forlano 
study (5) were 16. Hi for the asccndence-submission test, 2,1.07 
for the extroversion-introversion test and 26.79 *' or t ^ le emo- 
tional stability test. The possible range of scores on each of the 
tests was from to 35. The correlation coefficients which were 
obtained when the test scores were correlated with consistency 
of response scores on each test agree with what would be ex- 
pected from Hypotheses II and IV. ’1 he lowest coefficient, 
- .03, was obtained for the ascendence-submtssion test on which 
the mean score was* in the middle of the test scale (Hypothesis 
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IV). The next highest coefficient, .09, was obtained for the ex- 
troversion-introversion test on which the group mean was three 
points above the middle score (Hypothesis II). The highest 
coefficient, .36, was obtained for the emotional stability test 
on which the mean score was nine points above the middle of 
the scale (Hypothesis II). It is to be noted that Pintner and 
Forlano dealt with consistency scores rather than inconsistency 
scores which accounts for the reversed sign of the arefficients. 

Insummary it can be said that on the basis of certain assump- 
tions concerning the nature of psychological tests as measur- 
ing instruments, it has been possible to predict the size and sign 
of the correlation between inconsistency and test score for the 
present study and for previous studies where the necessary 
data were available. It has been shown that under certain con- 
ditions even if there was no correlation between inconsistency 
and test score, a correlation would nevertheless have been ob- 
tained. This finding throws doubt upon the results of previous 
studies which report inconsistency as a trait of behavior cor- 
related with intelligence and personality factors. 

Summary ami Conclusions 

In order to study inconsistency of response to test items, 
three psychological tests were given to a group of 135 subjects. 
The tests were re-administered to the same group one month 
later. A measure of inconsistency was determined fur each sub- 
ject. An analysis of the data indicated the following: 

1. For the sample employed in this study there were no 
significant differences in the proportion of inconsistency of re- 
sponse on an intelligence test, a personality test and an interest 
inventory. 

1. For the sample employed there was little relationship be- 
tween inconsistency of response on the three kinds of tests. 

3. An interpretation of psychological tests was developed 
which conceives of test items as points along a scale similar to 
the stimuli along a psychophysical scale. Within this frame- 
work inconsistency of a response to a test item varies with the 
position of that item above or below the threshold for the in- 
dividual concerned. 

4, On the basis of the above interpretation and with certain 
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reasonable assumptions, it was possible to predict the size and 
sign of spurious correlations between inconsistency and test 
score. 

5, The possibility of such spurious correlations throws doubt 
on the results of previous studies which report relationships 
between inconsistency and intelligence and personality meas- 
ures. 
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PSYCHOLOGICAL COUNSELING IN A PUBLIC SCHOOL 

KATHARINE W. DRESDEN 
Chico State College 

Many schools arc hesistant about introducing psychological 
counseling. There is a feeling that this service would be ex- 
tremely expensive and that it would be difficult to get adequate 
staff and office accommodations. Those who foresee many diffi- 
culties are undoubtedly thinking of a complete, finished, well- 
established Psychological Center. This is an aim toward which 
a school might well be working, but because it is not possible 
to start with it in this finished condition there is no reason for 
not starting. 

We, in Milwaukee, started psychological counseling in Sep- 
tember of 1946 in an exceedingly simple fashion; we are still 
just in the beginning stages but we feel that enough has been 
accomplished so that we can see a well-established department 
in the not-too-distant future. Also, we feel that we have had 
many experiences ill our first year which would be of value to 
other school systems and which might be an inspiration to them 
to get started immediately. 

We started with one psychological Counselor. She was an 
experienced teacher, having taught all of the grades in state- 
graded schools, and having taughtsocial studies in a Milwaukee 
high school for many years. During this time she had qualified 
herself to become an Advisement Counselor and had had the 
experience of setting up a new counseling system in one of our 
high schools. Through summer work and a leave of absence she 
further qualified herself for psychological counseling. 

When she returned from her leave, she was assigned to her 
new task and immediately proceeded to do testing for the 
Department of Special Education, ascertaining Special B or C 
placement for children who were mentally retarded. Mean- 
while, she gathered the necessary supply of testing materials 
and planned a procedure for making her services available to 
schools. 
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At their regular monthly meeting, the Counselor was pre- 
sented to the Milwaukee Principals’ Association. In a brief 
talk she outlined her fields of activity, explained the type of 
case she was equipped to handle, her method of referral and her 
plans for diagnosis and treatment. 

Requests-for-Psychological-Services cards were distributed 
to each school : 


REQUEST FOR PSYCHOLOGICAL COUNSELING ' 

Name 

Date or Birth Grade 

Reason for Requesting Study: 

I. □ Vocational Study i, □ Placement in Special Classes or School 
3. P Academic Proq- 4. Q Complete Case Study 
ress 

Brief Statement or Problem: (use reverse side if necessary) 


Principal 

School 

Date 


These were purposely kept very simple and only a minimum 
of data were required in order not to burden the teacher with 
clerical detail. These cards were to be signed by the Principal, 
thus insuring that he knew the request had been made. Occasion- 
ally cases were referred directly by an Assistant Superintendent, 
usually when the child was making an original enrollment in the 
Milwaukee schools or was transferring to another school. So 
many of these cards were returned to the psychological Coun- 
selor that it was impossible for her to respond to all of them. 
In February another Counselor was added to the staff; she 
specialized in primary children. The Supervisor of Guidance 
and Welfare took a number of cases himself, particularly emer- 
gency cases that were brought directly to the Central Office 
and were counseled with immediately. By spring, principals 
stopped sending in their requests as they knew they could not 
be honored during the school year. There are, therefore, no 
statistics available as to the number of pupils for whom psy- 
chological counseling was desired. There are no figures available 
for the cases taken by the Supervisor of Guidance and Welfare. 

Statistics kept by the two psychological Counselors reveal 
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455 cases handled, 327 boys and 128 girls. They were referred 
by: 

Schools 

58 Elementary I. Senior Trade 

3 Junior High (Other Trade Schools handled 

7 Senior High by Supervisor) 

a Junior Trade 
Parents: 7 


t their grade placements were: 


Grade 

flayt 

Girts 

Kindergarten 

26 

rr 

1 through 6 

18s 

60 

7, 8 and f) 

3 l> 

16 

I a, ! 1 and t a 

18 

12 

Special 
t hi.LV'igncd 

42 

*9 

20 

to 


Tcial 

37 

245 

52 

2 ? 

3° 


In age they ranged from 4 years, 6 months, to 18 years, 4 
months, each extreme being represented by a boy. The range 
for girls was 5 years, 7 months, to 17 years, 10 months. The 
mean age was: boys, 1 1 years; girls, 10 years, 10 months; total, 
11 years. The median age was boys, 10 years, 9 months; girls, 
10 years, 8 months; total, lo years, 8 months. 

It was difficult to assay the reasons for referring. Frequently 
a most casual surface reason was given even when the teacher 
knew that she was searching for something more basic. At 
times a number of reasons were given. Some indication of what 
teachers and principals were seeking aid for is indicated by 
these statistics; 


Reaionl Jar Rtjtrrinf 

Btyi 

Girls 

Totals 

Mental 

91 

58 

149 

Sociid 

124 

29 

1 53 

Emotional 

5 ° 

16 

60 

Academic 

144 

47 

191 

Attendance 

19 

8 

27 

Others 

13 

4 

17 


Upon receipt of the card the psychological Counselor cleared 
the case to see if it were already known to the Welfare Depart- 
ment, the Department of Special Education, or the Milwaukee 
County Guidance Clinic. If such was the case, they were con- 
sulted to see if they wished to work further on the case or 
wanted the psychological Counselor to go ahead with it. 

In most instances the Counselor saw the child in the school. 
This obviated the necessity of getting parent permission to 
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transfer the child to another place. It gave the child a feeling of 
security to be on his own ground, and it made the testing 
situation a natural part of the school routine which has habit- 
uated pupils to school-time conferences with doctor, nurse, 
principal, and so on, within their own building. The room used 
for the interview depended on the available accommodations — 
an unused classroom, a library, a teachers’ room, a nurses’ room, 
or even a supply room — any place where there would be no 
interruptions. 

When she reported to the school, the Counselor asked for the 
briefest possible statement of the problem from the Principal — 
it was a case of classroom conduct, achievement out of step 
with chronological age, special placement, etc. This gave the 
Counselor an indication of what the school wanted without 
predisposing her toward the child. Usually the child was 
brought to her in the conference room by the teacher or princi- 
pal and was introduced as in a social situation, the adult leaving 
as soon as possible, 

Alone with the child, the Counselor established rapport and 
then proceeded. Sometimes an interview sufficed. Usually a 
Stanford-Binet Revised L or M was given and such other tests 
as seemed necessary, A summary of tests given indicates: 


Tails Chen 

Boys 

Girls 

Total 

Stanford-Binct 

306 

123 

429 

Personality 

134 

40 

174 

Achievement 

*3 

7 

20 

Vocational — Interest 

12 

4 

J 6 

Aptitude 

l 4 

2 

16 


It is impossible to make a clear-cut statistical report of 
findings. The basic difficulty may be intelligence, which gives 
rise to emotional or social maladjustment; a physical disability 
which creates an emotional disturbance that has social effects; 
and so on. A crude division might be as follows: 


Maladjustment 

Bays 

Girl s 

Total 

Social 

9 X 

29 

120 

Emotional 

U 4 

38 

I 5 a 

Physical 

17 

14 

31 

Others 

6 

1 

7 


The intellectual capacities of those tested yield more readily 
to exact statistical recording: 


Level of Intelligence 

Boys 

Girls 

Total 

Average I: Q 90-110 

100 

3 * 

13 * 

Below 90 I.Q 

163 

108 

271 

Above 1 10 I.Q 

28 

12 

40 
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The range of IQ’s was 33 to 167, girls representing both 
extremes, boys ranging from 39 to 141. The mean IQ for boys 
was 88.4, girls 82.4, total 86.7, The median IQ for boys was 
88, girls 80.9, total 86. 

These findings were followed by definite action. If the testing 
was done in the school, the case was staffed with the Principal, 
and sometimes with the teacher, school-welfare Counselor, or 
parent as well. Some were automatically transferred to Special 
B or C classes or were recommended for exclusion. Where 
necessary, cases were referred to tire County Guidance Clinic 
or Health Department for further study. 


Sumruary 0 / Act Inn 

Boys 

Girls 

Total 

Staffing with p-indpal 

149 

6$ 

114 

with principal plus teacher 

108 

46 

1 54 
141 

with principal plus S.W.D. 

105 

36 

with principal plus parent 

29 

7 

36 

in Central Office 

H 

n 

13 

11 

KxcluMttn 

4 

8 

Special U or C 

17 

1 6 

33 

lUjerrai 

County Guidance Clinic 

ia 

l 

16 

Healtli Department 

ia 

10 

Others 

27 

3 

30 


No statistical summary can give a full picture of psychological 
counseling. To fully appreciate the magnificance of the service 
one must see a little girl freed of her worries, feeling the loving 
understanding of her teacher, happily meeting each day suc- 
cessfully; or a little boy who gradually gives up temper-tant- 
rums, faces his own deficiencies, and strives to overcome them; 
or a teacher who, realizing she will not be penalized because a 
charge fails to meet grade standards, can now help each child 
to grow to the maximum of his ability; or a principal who is 
reassured in his policy of giving every pupil status; and, finally, 
the joy of the parent who is assured that his "limb of Satan” 
is a perfectly normal extrovert who needs help in finding socially 
accepted means of expression. Were Casimir and Delores and 
Miss Wythe and Mr. Grayson each to appear in this report, 
each would tell a different tale, but all would stress the sense of 
immeasurable relief. All would agree that the task is not done. 
Many of these people need further help. The Counselor must 
not be so pressed by new cases that she has no time to re- 
counsel or to bolster up those counseled previously. After treat- 
ment starts, there is usually a period of slump and discourage- 
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ment when the Counselor should be able to go back immediately 
to help either child or teacher or parent. 

Another service rendered by the psychological Counselors 
was responding to the desire of the public for more information 
on the Department of Guidance and Welfare and on child 
growth and development. A five weeks’ course for mothers was 
conducted at the Emanuel L, Philipp School, No count was 
kept of faculty meetings, P.T.A.’s, church groups and service 
clubs which were addressed, nor of attendance at these, but 
several hundred people participated and many engagements 
have already been signed for next year. 

One year of psychological counseling has indicated many de- 
velopments which must come in the near future. First, of course, 
to service a city of this size there must be many more Counse- 
lors. The in-service training of teachers to recognize mental 
health problems before they become too far progressed must be 
emphasized. There should be a suite of offices including a con- 
ference room and a testing room available for each Counselor 
to take care of those cases which are brought into her office for 
counseling. There should be a city-wide testing program to 
screen out those cases which need attention. But all of this will 
come through a process of natural growth and as taxpayer- 
insistence grows. 



A NOTE ON PEPIN SKY’S ANALYSIS OF 
“VALIDITY” AND “RELIABILITY” OF 
SOCIOMETRIC DATA 1 


LINDSEY R. HARMON 
Veterans Administration, Fort Snellmg, Minnesota 

In her excellent paper outlining the errors of thinking that 
inhere in a direct application to sociometry of concepts custo- 
mary (although not unchallenged) in psychometrics, Pepinsky 
has failed to develop one significant aspect of pertinent theory. 
This theoretical consideration serves to strengthen further the 
precautions urged by the author with reference to the concept 
of reliability. 

Whatever means of determination are used, the concept of 
reliability is based on the idea that we are sampling from a uni- 
verse of data, and that we wish to generalize, within known 
limits of error, from the sample data to the universe from which 
the sample is drawn. In psychometrics, the data are almost 
always measurements of a sample of behavior; in sociometry, 
by contrast, the data are almost always directly descriptive 
of the universe itself. Hence the only possibility of error that 
would invoke the concept of reliability would be clerical or 
mechanical errors in handling the data, rather than errors of 
random sampling. A concrete example is balloting in a public 
election. If the votes are properly counted, the universe of 
pertinent data has been completely measured. An inference as 
to what the voting behavior might have been the next day or 
week, or under different weather conditions, etc., has no rela- 
tion to the ‘'reliability" o." the measurement. As Pepinsky 
points out, the sociological variables would then be changed, 
and we would have a different experiment. 

1 Pepinsky, Pauline Nichole. "The Meaning of ‘Validity’ and ‘Reliability’ as Applied 
toSodomctne Tests." EuutAriOHAi. ano Psyuiolooioal Mbasukbmbnt, IX, (1949), 

39-jo 
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ERRATUM 

In the article entitled "The Meaning of 'Validity' and 'Reliability' as Applied to 
Sociometric Tests," by Pauline N. Pcpinsky, which appeared in the Spring issue of this 
journal (1949), the phrase on page 40, line 6 , which reads “his status (in the case of 
choices given)" should be revised to read "his status (in the case of choices received)." 



the reflection of problem changes by thf 

MOONEY PROBLEM CHECK LIST 

LEONARD V. GORDON 
The Ohio State University 

The Mooney Problem Cheek List , College Form , covers a 
wide range of potential student problems. It was designed to 
enable the individual to state his problems by underlining rel- 
evant items, both for his own clarification, and as an aid to the 
counselor. It reveals only those problems that the individual 
is willing to admit or to discuss, and is not intended to be a 
depth technique for determining the "real problems” or “un- 
conscious conflicts” of the individual. It’s validity, therefore, 
depends upon the degree to which it reflects those problems 
that the individual is willing to discuss. 

One approach to the validity of the Check List is in terms of 
the first summarizing question on page 5 of the Check List 
(i, a) in which the individual indicates whether he feels that 
the items marked give a well-rounded picture of his problems. 
Another method would be to determine the degree to which the 
Check List reflects statements of problem changes from one 
administration to another, the statements of problem changes 
having been obtained by an independent measure. The latter 
method comprised the design of the present study. 

Method 

Members of five sections of a course in beginning Psychology 
served as subjects in the study, the sample representing a good 
cross-section of the undergraduate students at the university. 
At the end of the fourth week of the Winter Quarter, the sub- 
jects were asked to fill out the Mooney Problem Check List , 
College Form, and nine days later the Check List was read- 
ministered. After the Check Lists were collected, a special 
mimeographed form was distributed to the subjects on which 
they were asked to indicate whether any of their problems had 
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been solved, or whether any new problems had arisen during 
the previous nine-day period, and, if so, what those problems 
were. Thus, an independent statement of problem change was 
obtained to which changes in the way items were marked on 
the first and second administrations of the Check List, in the 
appropriate areas, could be related. 

Results 

In Table I, frequencies are presented for those subjects who 
indicated problem changes and for those who indicated no 
problem changes. Of the 116 subjects, 35 indicated one or more 
problem changes. No sex differences were found, chi square 
having a value of .002 for one degree of freedom. In all, the sub- 
jects reported the occurrence of 28 new problems and the solu- 
tion of 18 old problems. Each of 1 1 subjects reported two prob- 


TABLE 1 

Survey of tilde pendent Statements of Problem Change 



Change# 

No Changes 

Total 

Male 

SI 

49 

70 

Female 

14 


46 

Totnl 

3S 

81 

i r 6 


lem changes, and each of 24 subjects reported one problem 
change. The modal problem changes were concerned with 
changes in job status, changes in living quarters and receiving 
a low grade on an examination. 

Three judges independently assigned each problem state- 
ment to the area of the Moortcy Problem Check List to which 
it seemed to belong. There was agreement by all three judges 
on the allocation of 43 of the 46 problem statements, and there 
was majority agreement of two judges on the allocation of the 
other 3 problem statements. Table 2 contains the frequencies 
of occurrence of new problems, and solution of old problems 
according to areas to which they were allocated by the judges. 

Both forms of the Check List were then examined for each 
individual to determine what changes, if any, had occurred in 
the marking of the items from one administration to the other, 
in the area corresponding to the statement of problem change. 
In instances where new problems had been indicated, the Check 
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TABLE a 


Frequences aj Occurrence t,f Nets Problems and Solution oj Old Porblems, by Anas 


----- ■*■—.- 

IIPD 

ple 

SR A 

SPR 

PPR 

CSM 

HK 

MR 

ACtV~ 

FVE CTP 

Total 

Male 

New 

Q 

a 

1 

O 

0 

3 

0 

0 

4 

3 

3 


Old 

1 

3 

0 

o 

o 

1 

3 

o 

1 

z 



Female 

New 

1 

l 

i 

O 

o 

1 

a 

r 

a 

o 

3 


Old 

1 

3 

0 

o 

a 

1 

o 

0 

2 

O 



Total ‘ 

New 

1 

.3 

a 

0 

0 

4 

a 

i 

6 

3 

6 

28 

Old 

1 

ft 

D 

o 

o 

3 

3 

o 

3 

X 

0 

18 


TABLE 3 

Illustration! oj I rule pendent Statements of Problem Changes, and Items Marked in the 
Corresponding Areas of the Mooney Problem Cheek List , 

College Perm, /or F.oeh Administration 


Indcicndcnl Klalemtnl Aid 

"In hard courses 1 have in take, l CTP 
hove gone to my m-.uiicwr, and 
he helped me very much." 


“Baby on way." CSM 

“I had an unfair teal in physics " CTP 
"He ia of different religion-. beliefs MR 
than my own lie accord me of 
being ton prejudiced " 

"My mother got better very rap- 11F 
idly." 

"I'm beginning to find myself 
swamped with things to do," 


Item* Marked In Check List 1st 2nd 

Dull classes x 

Textbooks hard to understand x 

Being without a good college ad- x 
visor 

Classes too large x 

Forced to take courses I don’t x x 

like 

Insufficient knowledge about x 

sex matters 

Having unfair tests x 

Affected by rdigiouj or racial x 

prejudice 

Confusedin my religious beliefs x 

Sickness in the family x 

Living at home or too dose to x 
home 

Not enough time for recreation x 

Too little chance to enjoy art x x 
or music 

In too many student activities x 


TABLE + 

Rtfleetirm of Problem Changes by Items Marked in the Check List 


Hems Re-Skata# 

Problem 

New Problem 
Reported 

Old Problom 

Solved 

Marked only first 

0 

j6 

Marked only «umd 

aa 

0 

Marked both times 

5 

a 

Marked neither time 

I 

0 

Total 

■ag 

sS 


Lists were examined to determine whether items pertinent to 
the problem had been marked in the second administration, 
and had not been marked in the first administration. In in- 
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stances where old problems had been reported solved, the Check 
Lists were examined to determine whether pertinent items had 
been marked in the first administration, and had not been 
marked in the second administration. Table 3 contains several 
representative illustrations of independent statements of prob- 
lem change. The area of the Check List to which the statements 
were allocated is indicated, as well as all items in that area 
that were marked on the first and/or second administrations. 

In Table 4, the relationship between the problem statements 
and the marking of appropriate items on the first and second 
administrations of the Check List is indicated. The independ- 
ently stated problem was itself indicated on the Check List 
97.8 per cent of the time, while the direction of change was 
reflected 8a. 6 per cent of the time. Thus the Mooney Problem 
Check List, College Form, is highly successful in reflecting prob- 
lem changes that the individual is willing to admit, the prob- 
lem changes being determined by an independent measure. 

Summary 

The Mooney Problem Check List, College Form, was admin- 
istered twice to 1 16 subjects, with a nine-day interval between 
administrations. An independent statement of problem changes 
for this period was obtained from the subjects. A total of 46 
problem changes were indicated by 35 of the subjects. An ex- 
amination of corresponding changes in items marked from one 
administration of the Check List to the other indicates that 
the Check List is highly sensitive in reflecting those problem 
changes indicated by the independent measure. The problem 
itself was indicated on the Check List 97.8 per cent of the 
time, the direction of change being reflected 82.6 per cent of 
the time. 
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FACTOR ANALYSIS II: A NOTE CONCERNING RO- 
TATION OF AXES TO SIMPLE STRUCTURE 

DAVID R. SAUNDERS 
University of Illinois 

That the basic graphical single-plane method for the rota- 
tion of factor axes (5, Chapt, X) contains serious shortcomings 
has been implicitly recognized, since a number of attempts 
have been made to develop an improved alternative. Two gen- 
eral methods have been employed in these efforts: (a) the in- 
clusion of more information within a single graph by plotting 
in three dimensions (5, Chapt. VII) or by using extended vec- 
tois (4), or (b) the development of semi-analytical techniques 
(a, 8) to make the treatment of data more automatic. Most of 
these methods tend to contradict their purpose, in that they 
give up the relatively simple theoretical and computational 
scheme of the basic method. Only partial success has been re- 
ported in dealing directly with the principal drawbacks of the 
basic method, which are its slow convergence and frequent 
ambiguity of procedure; however, several distinct methods of 
relieving the routine computational burden per se have been 
described (1, 6, 7, 9, xo). It is the purpose of this note to report 
a further step in making simple structure rotation generally 
feasible, 

Simple structure is defined, not by the pattern of high fac- 
tor loadings which may exist, but by the distribution of neg- 
ligible loadings between the variables and factors. In order for 
simple structure to be overdetermined (and scientifically con- 
vincing) each column of the factor matrix must contain more 
essentially zero entries than the number of factors after elim- 
inating from consideration all variables which lack any signifi- 
cant loading. Each hyperplane must, in addition, be distinct 
from every other. The problem of finding the best simple struc- 
ture, if it exists, is thus resolved into the problem of finding the 
hyperplanes which will best determine it. 

7,53 
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In the first place, therefore, it is necessary to possess some 
consistent objective criterion to judge the goodness of a hyper- 
plane, and the probable improvement to be achieved by a given 
transformation of axes. A very convenient criterion to use is 
simply the number of vectors lying within el given small dis- 
tance of the hyperplane, say within .10 or ,15 at first, and later 
within .05 (1), (Other statistical criteria are more suitable for 
evaluating the goodness of a hyperplane finally found (3).) 
The criterion can be evaluated not only for the present posi- 
tion of a hyperplane, but also for any simple shift against 
another hyperplane when the graph with the other factor has 
been plotted. Increasing this criterion number will certainly 
lead toward final simplification of structure. That transforma- 
tion may be considered to be best which leads to the greatest 
immediate increase in this index of goodness of hyperplane; 
however, the search for this shift has heretofore been a most 
tedious aspect of rotation. 

What are the characteristics of graphs on which good shifts 
are to be found? They contain a relatively large number of 
vector termini not counted in cither hyperplane by the criterion, 
some of which can be brought into a hyperplane by rotation. 
These graphs also contain a relatively large number of vector 
termini common to both hyperplanes, which constitute a pool 
of termini that cannot be lost from the hyperplanes by any 
rotation in the plane of the graph. These characteristics will 
tend to occur together, and either might be made the basis for 
determining which graphs are worthwhile plotting. 

In practice, it has been found convenient, first, to count the 
actual number of variables held in common by each and every 
pair of hyperplanes. The number to be expected on the basis 
of chance is given by the formula, 

Pit - ( 1 ) 

where H is the number of variables in a hyperplane and n is the 
total number of variables. Thus, Ht/n is the proportion of varia- 
bles in they'th hyperplane, and this proportion of H t would be 
expected to be common to both hyperplanes i and j. Graphs 
are then plotted and examined first for those combinations 
of factors which show the greatest excess over chance. 
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Graphs may be eliminated from consideration when shifts 
for both of their factors have already been discovered. Using 
this plan, it is initially unnecessary to plot many more graphs 
per rotation than the number of factors being rotated. Of course, 
if shifts are not found from the most likely graphs they must 
be sought on others, which will be plotted in the order of their 
likelihood of showing good shifts. Each over-all rotation may 
require a somewhat greater number, and rotation cannot ter- 
minate until a complete set of graphs has been prepared with- 
out discovering any shift. 

When simple structure has been achieved, all of the factor 
pairs will tend to show less than the chance number of varia- 
bles common to their two hyperplanes. This follows from the 
requirement that simple structure hyperplanes must be dis- 
tinct; variables not in one hyperplane must tend to be in 
another. Accordingly, relatively few variables should be in 
neither of two hypcrpluncs, and, simultaneously, relatively 
few will be common to both. Of course, the joint hyperplane 
of two cooperative factors will yield less easily to this tendency. 

The procedure is equally applicable whether orthogonal or 
oblique axes arc being utilized. When using oblique factors, it 
is not generally necessary to compute the angles between the 
factors at every stage, for if any factors converge too closely 
their graph will be called for by the procedure. 

Summary 

A labor-saving device has been described to aid in the graph- 
ical single-plane technique far rotation of factor axes to sim- 
ple structure. By counting the number of test-vector termini 
which are common to two hyperplanes, the probability of find- 
ing a desirable shift of axes from an actual plot of the factors 
can be estimated, The number of plots which must be made is 
thereby greatly reduced, and rotational efficiency is markedly 
increased. 
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PERSONALITY TESTS AS A MEANS OF ENTRY FOR 

COUNSELING 

DUGAIJ) S. ARBUCKLE 
Boston University 

Batteries of tests are today being administered to students 
in colleges and universities throughout the land, and included 
in some of these batteries are personality tests. The purpose of 
a study recently carried out at the Boston University School 
of Education was to attempt (i) to determine whether or not 
the results of such personality tests could be used by the coun- 
selor as a means of entry into a more personalized counseling 
situation, and (a) to compare the effectiveness of the directive 
and nondirective approaches in the interpretation of these 
test results. The validity of any test results are based on many 
assumptions, and certainly two of these are that (i) the indi- 
vidual has answered the test to the best of his ability, and (2) 
while he was taking the test he was not under any unusual or 
atypical stress or strain. These assumptions are ridiculously 
simple, but it would seem that their very obviousness may 
have caused them to be overlooked by some of the test-happy 
test interpreters. The attitudes of many students taking group 
tests, as well as many of those who have been forcibly directed, 
for their own good, into taking individual tests, are often those 
of apathy and unconcern. The answering of the test is an un- 
pleasant job that will be performed in the easiest possible man- 
ner, and this method of answering usually means that the 
student is not putting forth his maximum effort. It is also a 
difficult task to determine the stress and strain under which 
an individual may be laboring when he takes the test, and in 
the administration of tests to groups it would seem that every 
tester would at least be aware of individual differences. Devia- 
tion would be more easily determined in the individual situa- 
tion, but no tester has any guarantee that the emotional state 
of the client, as he writes the test, is truly representative of 
his normal state. 
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There are too many educational institutions where tests are 
administered for, apparently, the sake of the test — or to keep 
the tester busy. There is no indication of any other purpose, 
and sometimes test results may be seen buried in dust — -the 
students have never been given the results, and the results 
have never been used by the educators to benefit the students. 
Certainly, if tests are to be used as a personnel instrument, there 
should be some purpose behind their use, and there should be 
some evidence to offer as to the positive effects of their use. 

Tests, like the human race, have their classes of respecta- 
bility, so that intelligence tests such as the time-tested Binet 
are well up in the scale of acceptability, while others occupy a 
much lower rung in the ladder. Just as different kinds of the 
same type of tests have their levels of acceptability, so the 
different kinds of tests vary from almost complete acceptance 
to ridicule. The better tests of scholastic achievement and of 
aptitudes are generally accepted as valid, but when one steps 
into the delicate aiea of personality tests the noise of conflict 
may be heard for many miles. 

There are many factors which cause personnel workers to be 
skeptical about the questionnaire type of personality tests such 
as the Bernreuter and the Bell. One may take an interest test 
and feel no personal disgrace if one is more interested in the 
social-service area rather than the mechanical area, or an ap- 
titude test which indicates that one may have potentialities in 
the mechanical line but not in the field of music. One may 
even rationalize on an achievement test and blame the school 
or parents for one’s poor showing, although this is not always, 
by any means, rationalization. When personality factors, how- 
ever, are being tested, the individual is getting into an area 
where deviation is most socially unacceptable, and just how 
many individuals will answer correctly questions which pertain 
to the extent of their constipation or the degree to which mother 
loves father, we will never know. 

One may question the value of giving any sort of tests to in- 
dividuals who have not indicated that they want to be tested 
— that is, if the tests are to be used for counseling or some 
other positive purpose. Certainly the nondirective school of 
counselors believe that what is important to the client is also 
what is important to the counselor, and if the client is not will- 
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ing to accept the scientific evidence that the tests will lay be- 
fore him, then there is little purpose in administering the tests. 
On the other hand, there are those personnel workers who will 
say. . • .“Well, we do, after all, have to find out something 
about the student so that we can know who needs counseling 
and who does not need it, and therefore it is essential that a 
test battery he administered to all students." The assumption 
in this somewhat directive statement is that counseling is 
something that is done by the counselor for the client, rather 
than a process which enables the client to do something for 
himself. Whatever one's feelings on this matter may be, how- 
ever, it is a fact that personality tests are being administered 
as part of a total-test battery. 

In the study being reported here, the Bell Adjustment In- 
ventory was added to a battery of tests — Psychological, In- 
terest, and English- that were administered to a group of 130 
freshmen students. The students were invited by means of the 
bulletin board and an oral invitation in class to come to the 
Personnel Office to have the test results interpreted to them. 
This invitation was nothing more than that — it was indicated 
that the results were available, and the Personnel Office would 
be glad to interpret them if the students so desired. Wire re- 
cordings were made of the interpretation process, and the in- 
terpreters used two main techniques in attempting to deter- 
mine the student reaction. 

The first technique was directive in nature, and was used in 
approximately half of the cases. In many of these, however, 
the student soon showed a willingness to talk, and in such cases 
the counselor became nondirective. That is, the directiveness 
was continued only when the student showed no desire to elab- 
orate, as is indicated in the example below. In this case, the 
counselor had just finished a factual presentation of the test 
results: 


C: , . . Do you feel those are fairly accurate? (long pause) For 
example, the general order of the four items, indicating 
where you show the most and the least concern? 

S: What does least concern mean? 

C: Well, this would mean that in the four areas you showed the 
least in the way of probable worry in the home area, 
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and You -would appear to be the most concerned in the 
health area . . . 

S: Well, to tell the truth, I was never concerned about my 
health. . . . (laughs) 

C: You never worried about it 

S: No . . . 

C: You don’t feel that you have any troubles in that area? 

S: Uh-huh. ... 

C: You can’t think of any background or reason for. .... 

S : No ... no idea at all. . . . 

C: No history of disease or anything of that nature? 

S: No (laughs). 

C: Ah-huh. . .. well, I guess that’s about the way it stands, 
Don, . . . 

This sort of approach would make all nondirective counselors 
squirm. The probing would make it seem that the counselor 
is attempting to do his best to get the client to admit that the 
test results are correct. This would appear to be completely 
futile at best, and dangerous at worst. If a client does not 
agree with a test result, there is no point in trying to force him 
to admit that the result U correct, and that he, verbally, at 
least, is wrong. There is little likelihood of positive results when 
the client battles the counselor attempting to prove to himself 
that the counselor is wrong and that he is right — as he may be. 

When the nondirective technique was being used a rejection 
of the test results similar to that in Example 1 resulted in a 
brief exchange such as is given below: 

The counselor had given the test results in an understandable 
fashion without interpretation. 

(long silence) 

C: . . . (long pause) 

S: Oh, I don’t know, These don't seem very accurate to me. 

C: You don’t feel tl at the indications of concern in these areas 
is correct. . . . 

S: No, I don’t. . . . 

C: Uh-huh (pause) . Well, that seems to be about all there 
is to this, Bill. 
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The counselor here believes that the client has the right to say 
as much or as little as he pleases, and in this case he expresses 
his desire to say little. The door is left open and the student 
may return. In the first example, on the other hand, the client 
showed a similar lack of desire to elaborate, but the counselor’s 
attempt to pressure him into elaboration was obviously futile, 

This nondirective technique sometimes resulted in a more 
moderate elaboration. For example, the counselor here has 
just finished a factual presentation of test results. 

S: Well . . . (long pause) 

C; (A brief summation of the results) 

S: (pauses — then laughs) Ye . . es . . . Yeh, those are right, I 
guess. At home everything goes on all right, so I don’t 
think too much of what goes on around there. . . . (laughs). 

As far as the social Is concerned — well, I do wonder where I 
stand at times, . . . (laughs) 

C: Ah-huh . . .(pause) You feel that sometimes you’re not too 
sure of where you’re going, or — 

S: Yeh — I mean— I've always been trying to figure out just 
wlmt I wanted to do when I get out of here. . . . 

C: Ah-huh 

S: I never have been able to figure it out though . . . 

C: You feel that you haven’t come to any final answers. . . . 

S: Well, this YW work does seem to be the thing all right — I 
mean, I have worked with girl scouts a lot, and this seems 
to be pretty closely associated with it — I really do like the 
work in scouting. ... 

C: Yeh . , . (pause) You sort of feel that it’s the job for 
you. . . . 

S: Yes ... In New York I worked for awhile in a dentist’s 
office as a technician, but the long grind was pretty dull and 
uninteresting. . . . (long pause) 

C: Ah-huh . . . (long pause) Well, Mary, I guess that’s about all 
there is there 

Of the 130 students who were tested, 73 accepted the invita- 
tion and came to the Personnel Office for test interpretations. 

Of the 73, 53 students generally agreed with the test results. 
Of these 53, £9 gave no elaboration (such as is indicated in 
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Example a), 17 gave moderate elaboration (such as is indicated 
in Example 3), and 7 gave extensive elaboration — they went 
into much detail, covered much more ground than was indica- 
ted on the test, and came back for further contacts with the 
counselor. Of these same 53 who agreed with the test scores, 
13 had all their percentile scores above the mid-point (national 
norms) while 40 had I, 2, 3, or all 4 items below the mid-point. 
Of these 40, 17 had one item below the mid-point, 11 had a 
below the mid-point, 9 had 3 below the mid-point, and 3 had 
4 below the mid-point. Of the 24 agreeing students who elab- 
orated, only two had all four items rated above the mid-point. 

Eighteen students disagreed with the test scores. Of these, 

7 gave no elaboration, 9 gave moderate elaboration, and 2 gave 
extensive elaboration. All of the eighteen had test scores be- 
low the mid-point in one or more items — 11 had one item 
below the mid-point, 3 had 2 items below the mid-point, and 3 
had 3 items below the mid-point. All of the disagreeing stu- 
dents who elaborated had scores below the mid-point. 

Approximately half of the students were treated in a direc- 
tive fashion, the other half in a nondirecrive fashion. There was 
no conclusive statement as to the effectiveness of each method 
of approach since the counselor generally tended on those cases 
where he was deliberately using a directive technique to be- 
come nondirective if the client began to elaborate. The only 
specific statement which can be made in this regard is that in 
no case did the directive approach result in a reticent student 
beginning to elaborate. On the other hand, in five cases students 
who were treated in a nondirective fashion and came forth with 
moderate elaboration indicated a reticence at the beginning 
which may have resulted in no further elaboration if they had 
been treated directly. This, or course, is only surmise. 

Of the 57 students who did not come to the Personnel Office, 
23 were above the 1 mid-point in all four areas while 34 were 
below the mid-point in one or more areas. Of these 34, 21 were 
below in 1 area, 7 were below in 2 areas, 2 were below in 3 
areas and 4 were below in 4 areas. 

The mid-point scores (percentile rankings based on national 
norms) of the 73 students who came for test interpretation 
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compared with the 57 students who did not come are as fol- 
lows: 

Did Come Did Not Came 


Home 

70 

80 

Social 

85 

80 

Health 

35 

35 

Emotion 

70 

80 


Of the 18 students who were rated the lowest on the test 
(below the mid-point in 3 or 4 areas) in came to the Personnel 
Office, 6 did not come. 

A General Summation of the Results 

I. Slightly over one half of the students who were tested 
came to the Personnel Office to have the test results interpre- 
ted. From the standpoint of deviation there were no significant 
differences between the mid-point scores of those who came to 
the Personnel Office compared with those who did not come. 
However, approximately 60 per cent of the students in the “did 
not come” group were below the mid-point in one or more areas 
of the Bell, compared with about 80 per cent in the “did come” 
group. Probably the most interesting item in the mid-point 
scores was the extremely .low rating in the health area in both 
groups. 

d. Of the 18 students whose tests results indicated the pos- 
sibility of most concern, 12 came to the Personnel Office. 

3. The greatest elaboration came generally from those who 
showed the greatest deviation. 

4. With the directive approach the nonelaborating students 
remained noncommittal, whereas in 5 cases reticent students 
did come forth with more elaboration when the nondirective 
method of approach was used. These students, of course, might 
have elaborated equally well if a directive approach had been 
used. 

5. An interesting sidelight was that a number of the “disa- 
greeing” but “elaborating” students, while stating that a low 
score on the health item was incorrect, came forth with the 
following information: 

a) One had been a test pilot during the war, and his diet 

had been highly emphasized, 
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b) One was a boy who was very much overweight. 

c) Three were star athletes concerned about their con- 
dition. 

d) One girl was a Christian Scientist. 

e) One had a mother who had died of cancer. 

f) One had a sister who had died of leukemia. 

g) One was a student whose father was very ill with what 
was believed to be cancer. 



THE PERFORMANCE OF AMPUTEES ON MOTOR 
DEXTERITY TESTS 1 


HAROl-D CiF.lST 
Stanford University 

This paper gives a report on the effectiveness of the prosthe- 
ses which arc currently being used by arm amputees who have 
gone through the Mare Island Amputation Center. Results on 
amputees who have taken approved Veterans Administration 
Manual Dexterity Tests are given. The study began under the 
direction of the author and was undertaken for the purpose of 
determining whether the current prostheses used by amputees 
were effective insofar as performing essential operations de- 
manded by standard Veterans Administration Motor Tests. 
Since the Veterans Administration is concerned with the vo- 
cational rehabilitation of disabled veterans, such a study would 
have wide implications in rehabilitation in respect to the ability 
of arm amputees to compete with non-handicapped people in 
industry. Since the sample was small, the results are not meant 
to he by any means conclusive but merely as indicative of 
signs or trends of the ability of arm amputees to perform cer- 
tain essential manual motor functions. 

Subjects 

The subjects used were arm amputees who were either hos- 
pitalized at the Mare Island Naval Hospital or who had been 
hospitalized and returned for further treatment. Seven (7) uni- 
lateral amputees were chosen and two (2) bilateral amputees 

'The author tvidhe-i to rxpr<- his appreciation to Dr. Thomas Canty, Chief, Arti- 
ficial lamb Department, Mare I slant! Naval Hospital, and to Mr. C. C. Asbelle, Re- 
habilitation Coordinator, Artificial Limb Department, Mare Island Naval Hospital, 
for their uwtperaiittn in letting me use amputee patients for this project. I also wish to 
ex pic.;, thank* m Dr, Edwin Ghiselli, Associate Professor of Psychology, University 
of California, at wlm.c siiMpuinn this paper was prepared, and to Dr, H. B. McDan- 
iels, Asamair Professoral Psychology and Education, Stanford University, and to Mr. 
Andrew J). Roberts, Stanford University, who reviewed the manuscript and offered 
valuable suggestion-.'. To Mr. Walter Toad, Chief, Advisement and Guidance Section, 
Veterans Adm'mistration, San Francisco, Regional Office, nw thanks for permission 
to present this* paper before a meeting of Guidance Center Chiefs of Northern Cali- 
fornia, 
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who were German PW’s and sent to this country for further 
observation, comparison, and further treatment. Their ages 
ranged from 19-2.8 years. 

'Types of Amputations and Prosthcses 

There are essentially four (4) types of arm amputees: 

1. RAE — right above elbow 

1. RBE — right below elbow 

3. LAE — left above elbow 

4. LBE — left below elbow 

There are four (4) main types of arms made at the Mare Is- 
land Artificial Limb Shop. These are: 

1. The Navy Fitch Arm. The Navy Fitch Arm is used on 
above-elbow amputees. 

a. The Standard Arm. The Standard Arm is used on below- 
elbow amputees. 

3. The Carpal-metacarpal Arm. These are worn by hand 
amputees, and are partial hands fitted usually at the carpal- 
metacarpal joint. 

4. The Cosmetic Arm and Glove. These are used mainly for 
finger amputees and are merely simulated hands made from a 
material which simulates very closely a normal hand. 

There are several modifications of these according to what 
is desired by the patient. The pronator-supinator suction cup, 
for example, is used on both the above-elbow and below- 
elbow arms. Functional hinges are used on the carpal-meta- 
carpal and above-the-elbow arms. For purposes of clarity only 
the first four categories will be designated here. 

The German PW’s brought with them a pair of Sauerbruch 
arms with cineplastic motors; one had biceps-triceps, the other 
pectoral motors. 

Description of Subjects 

The subjects of this project, the type of amputation, the type 
of arm, and the length of time the patient had the arm are as 
follows: 


Subject Age Type of Arm 

I aa Carpal -metacarpal 

II 19 Standard 

III no Standard 


Typo of Amputation Time Tfad Arm 

month* 

R. Partial Hand ai 

LBE 4 

LBE 6* 
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Sotted 

Ar« 

TYr?«r Arm 

Type of Amputation 

Time Had Arm 

IV 

2 2 

C arpaS * m c t a t xrp ai 

R. Partial Hand 

matt lit 

2^- 

V 

26 

Navy Viuh 

RAF. 


VI 

a a 

SvaficUrd 

RBE 

I 4 

j L 

VII 

22 

Navy Fufh 

RAF 

loi 

VIII 

22 

Fikn 4k Cm^laMic 

BAF (bilateral) 

IOf 

IX 

1% 

Navy Fiuh Cin«f*!a«cic 

BAE (bilateral) 

Il| 


P als Used 


The tests used were: 

1. Pennsylvania Pi-Manual Work Sample 

a. Purdue Pegboard 

3. Minnesota Rate of Manipulation Pest 

4. Minnesota Spatial Relations Pest 

The O'Connor Finger and P tveezer Dexterity P est was origin- 
ally attempted but the results were so poor that these tests 
were discarded. 

i. The Penn-Pi-Manual Work Sample (3) was chosen be- 
cause it “combines finger dexterity of both hands, gross move- 
ments of both arms, eye-hand coordination, bi-manual coordin- 
ation, and gives indication of the individual’s ability to use 
both hands in cooperation." Such a test would afford a good 
measure of the relative speed of operation of the prosthetic 
hand in conjunction with the normal hand or, in the case of 
bilateral amputees, of the two prosthetic arms together. 

•x. Only the placing section of th 0. Minnesota Rate of Manipu- 
lation Pest (5) was used. The Minnesota Rate of Manipulation 
Pest was used because it measures muscular reaction time. 
This is a very unique trait which determines, to a high degree, 
native speed capacity. A comparison of the prosthetic hand 
with the normal hand in this test would give a valuable indi- 
cation of the ability of amputees to perform certain tasks in 
shop and office work where use of tools and materials is needed 
and where speed is a very important factor, 

3. The Purdue Pegboard (a) is a test of manipulative dexter- 
ity. Since it provides separate measurements of each hand, both 
hands together, and gross and fine movements of the hands, 
fingers, and arms, it is an excellent means of comparing the 
prosthetic hand and the normal hand which would provide a 
measurement of comparative dexterity needed in small as- 
sembly work, 

4. The Minnesota Spatial Relations Pest (1) is a test of general 
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mechanical ability and would give a strong indication of the 
ability of the prosthetic arm to do general mechanical work. 

Testing Procedure and Results 

Purdue Pegboard . — AVI parts of this test were given. Each 
subject was allowed to sit or stand while performing the test. 
Each part was given on both the prosthetic arm and the nor- 
mal arm. On the assembly section, the prosthetic arm was used 
in conjunction with the normal arm. The three trial norms 
were used. 

Analysis of Test Results . — The criterion of effectiveness and 
the measurement of the ability of the amputee to perform tasks 
demanded by the Purdue Pegboard and the other tests admin- 
istered was a moot problem. It is indicated that no score in 
itself would have significance. Comparisons would have to be 
made between the normal hand and the prosthetic hand and 
those reaching the fiftieth percentile of the population upon 
whom the test was standardized. Since the raw scores of the 
prosthetic hands were too low to be measured in percentile 
equivalents, no comparisons could be made in percentiles, but 
merely between raw scores. The mean was taken of the sum of 
the three trials of each section of the test for all subjects and 
this was computed as a comparison between the prosthetic and 
normal hand. The “number times as slow” of the prosthetic 
hand was taken rather than the amount the normal hand was 
“as fast.” 

Where both hands were used, the results were compared with 
those reaching the 50th percentile upon whom the test was 
standardized (norms of Purdue Pegboard) which, in this case, 
were 456 veterans of the City College of New York Counseling 
Center. The reason that the fiftieth percentile was chosen was 
because this most nearly reaches the average group. 

Minnesota Spatial Relations Test . — Likewise here a compari- 
son was made between the scores on the prosthetic hand and 
the normal hand. During the performance of the test, the sub- 
ject was permitted to turn the blocks over with the normal 
hand if he dropped the block and it turned on the reverse side. 
All of the subjects dropped at least one block. A comparison of 
the prosthetic hand and those reaching the mid-point of grade 
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C letter rating was also made. Grade C was taken as the av- 
erage. 

As a matter of interest, a comparison was made between the 
two types of arms worn by the German PW’s and the American 
Navy Fitch arm, i.e., a comparison between the German arms 
and the American arm worn by the same subjects (the Germans 
used these arms interchangeably). It was found that on the 
left arm of one German, the VS. arm was 25 per cent faster as 
measured by the Minnesota Spatial Relations test, and that on 
the other arm of this same PW, the German arm was » per 
cent faster on one arm, and on the other arm the German arm 
was 3$ per cent faster. 

Minnesota Rate of Manipulation T est. — Likewise here a com- 
parison was made Initwccn the normal hand and the prosthetic 
hand in respect to placing the blocks in their proper slots. The 
turning section of the test was not used because very few of 
the subjects could prnnate or su pin ate sufficiently to turn the 
blocks. 

Practice Effect.- -The Minnesota Rate of Manipulation Test 
by its very nature, gave an indication of the effect of practice 
on performance. Because the same material was used on four 
successive trials, information might be gleaned on the effect of 
practice in performing the same task. The ideal situation would 
be where the same tests were used repeatedly over a spaced 
period of time, but time limitations precluded such an attempt. 
Eighty-five per cent of the subjects tended to get better from 
the first to the fourth trial while 15 per cent got worse. The 
range was from a decrease of 63 seconds to an increase of 184 
seconds. These data are very significant inasmuch as practice and 
fatigue elements tend to neutralize one another, but it appears 
that the effect of practice has a very potent effect on muscular 
reaction time where a prosthetic arm was used, and seems to 
overshadow the effect of fatigue. 

Pennsylvania JU Manual Test. — Instructions were that the 
subjects grasp the nut with the normal hand. Here, again, 
the comparison was made with those reaching the ^oth per- 
centile. 

Result s,-R\\ of the testa except the Purdue Pegboard show 
relatively little difference between the normal hand and the 
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prosthetic hand. As was stated in the beginning of this paper, 
the results here are only indications of trends, The very fact, 
however, that arm amputees can perform the operations de- 
manded by these motor dexterity tests are of significance. 
Such results would seem to indicate to employers that arm 
amputees are able to perform tasks ordinarily thought of as 
extremely difficult or impossible. 


TABLE i 
Summary of Da fa 


Com- 

pari- 

Comparison son of 

of Means Medians of Medians Means 
Mean of Mean of of Pros- Subjects of Sub- Proa- 

Subjects Subjects thetic and and Jects thcllc 

Normal ProflLnetlc Normal Normal Prosthetic Normal 

Test Arm Arm Arm Arm Arm Arm 


Purdue Pegboard 10.8 1 10.8 

Comparison of Prosthetic Arm 
and Those Reaching 50 Per- 
centile 

Assembly mean 7 3 

median 6 

Both mean 7.3 

median 10.5 

Minnesota Spatial Rela- 1019" 2016* 1.9 

tions 

Comparison of Prosthetic Arm 
and ^ Those Reaching 50 Per- 
centile 
mean 2.1 
median a. 3 

Minnesota Rate of Mnnip- 227* 559* 2.4 

ulation 

Comparison of Prosthetic Arm 
and 1 hose Reaching 50 Per- 
centile 


10 4 1 10.4 


854* 1828* 2 . 1 


(Grade C Rating) 


250* 503* 2.0 


mean 2.2 
median 2.2 


Penn Bi- Comparison of Prosthetic Arm and Those Reaching 50 
Manual Percentile 

mean Assembly 3.0 mean Disassembly 2.0 

median Assembly a. 5 median Disassembly 3 o 


Large manufacturing companies have started recruitment 
campaigns for amputees, not on the basis of pity, but because 
hitherto unthought-of skills and abilities have been demon- 
strated. On a national basis (4), amputees with the use of one 
arm have entered such occupations as carpenter, electrical 
repairman, floor assembler', pipe-fitter, combination welder, 
tool-grinder operator, hand saw filer, tool maker, turret lathe 
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operator, arc welder, shipping clerk., electric bridge crane opera- 
tor, truck crane operator, and stranding machine operator. 
Amputees who have lost both arms have become laborers, 
machinists II, structural steel workers, job setters II, laborers, 
process (machine shop), sub-assemblers I, and turret lathe 
operators. A partial list of occupations of veteran arm amputees 
in northern California are: carpenter, linotype operator, clerk, 
student physicist, fui trapper, storekeeper (civilian) in Navy, 
landscape artist (using prosthetic arm for painting), chicken 
rancher, construction foreman, heavy equipment salesman, 
mailman, and elevator operator. 

In the recent report by the Bureau of Labor Statistics on the 
Performance of Physically Impaired Workers in Manufacturing 
Industries ( 4 ), the data available with respect to the subject of 
the prosthetic aid used and its effect on performance in indus- 
try are too fragmentary to be of any significance. However, a 
recent report of the Director of Training at the Columbia Steel 
Company in Pittsburg, California, corroborates the result of 
this project (many of the amputees hired there were subjects of 
this experiment). The work output involving manual motor 
dexterity of the arm amputees has in many cases equalled and 
in some cases exceeded that of the "normal” employees. 

Summary.--* Nine arm amputees, seven unilateral and two 
bilateral, were given four standard Veterans Administration 
Molar Dexterity 'Pests, the Purdue Pegboard, the Minnesota Rate 
of Manipulation, the Minnesota Spatial Relations, and the 
Penn-Bimanual Work Sample. Comparisons were made be- 
tween the means and medians of the group on the normal and 
prosthetic arm, and with the score of the 50 th percentile on 
whom the test was standardized. Results of the comparison 
between the normal and prosthetic arm show that the prosthe- 
tic arms compare favorably with the normal arms with respect 
to motor dexterity with the exception of the Purdue Pegboard. 
The results are corroborated by manual work output of am- 
putees at the Columbia Steel Company, Pittsburg, Cal. 
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A GRAPHIC SOLUTION OF MULTIPLE AND PARTIAL 
CORRELATION COEFFICIENTS FOR 
THREE VARIABLE PROBLEMS 1 


MELVIN D. DAV1DOFF 
Purdue University’ 


Trigonometric representation, of correlation relationships 
may be both useful and instructive. 

In the discussion that follows t“ r«s. will denote the partial 
correlation coefficient between variables a and b with variable c 
held constant. 

"Re. nC* will denote the multiple correlation coefficients be- 
tween variable a and the combined effects of variables b and c. 
In terms of xero order correlation coefficients : 







and 


2 2 

7~ah “f" Tee Taa f^bc 


i — ru 


It can be shown (1,2,4) that if a spherical triangle (Fig. I) is 
constructed so chat: 

ru « cos a * 
ru “ cos b* 
fit “ cos c* 


then the following relationships hold true: 


The cosine of the spherical angle A = r is .» 
The cosine of the spherical angle B - r u . 1 
The cosine of the spherical angle C — r S3 ,i 
The cosine of the altitude from C on AB = Ri.jd 
T he cosine of the altitude from B on AC = Rj.u 
The cosine of the altitude from A on BC = R>.u 


1 This paper is based on part of a paper submitted m June, ijwi, , to ' Purdu ‘Uni 
versity in partial fulfillment of the requirements of a Mh» o ^S cience : ‘ n 

Psychology. The thesis was directed by Dr. E. Lowell Kelly. The drawings in the present 
patter were adapted from the original manuscript by Mr. Irving Sherman of Purdue 

* », b/and 0 are used here as the angular measure of the arcs indicated. 

» Now with the U. S. Civil Service Commission. 
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Multiple Correlation Coefficients 

The multiple correlation coefficients can be easily determined 
by the reading of the angular values, or their cosine equivalents, 
of altitudes taken upon the three sides of the spherical triangle. 
This may best be done with a strip calibrated as described 
on page 77 6. 


Partial Correlation Coefficients 

It is possible to measure the vertex angles (or their cosines) 
of the spherical triangle directly, but this requires considerable 
effort in the construction of equipment. Making use of the 


A 



C 


Fig. I 



following relationship, we can lessen the complexity of the 
preparations for the graphical determination (Fig. II). 

From any point A on a sphere o, 90° arcs c and b of great 
circles AB and AC are drawn. An arc between the points B 
and C is drawn by tracing a flexible straight edge held rigidly 
against the surface of the sphere and connecting points B and 
C. Angle A can be shown to be equal to arc a (in angular 
measurement) (a). 

The implications of this relationship are rather obvious, i.e., 
if, instead of measuring directly an angle, e.g., A (Fig. I or II), 
between two arcs of great circles, we extend the arcs determin- 
ing this angle to 90°, the arc of the great circle passing through 
the limits of their extensions equals the angle at the vertex 
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(here A). The arc in question is determined by a flexible edge 
describing, the shortest arc between the limits of the extension 
(e.g., H and C in Fig. II). The flexible edge has but to lie flush 
with the surface of the sphere between the two points involved 
to describe this shortest arc. 

The following figure is a guide to the whole process of deter- 
mination of the multiple and partial correlation coefficients. 

At. Ah =» BJ «= BH =» Cl = CG = 90 0 



Itig, III 


Practical Procedure 

The author (op. cit .) has given two methods of procedure, one 
involving the use of pins and strings in a manner analogous to 
the use of these materials in factor analysis (3). The other 
method, to be presented here, is somewhat easier and probably 
more accurate although involving the construction of a simple 
piece of equipment. 

Let us conceive of a cylinder open on one end with an inner 
perimeter equal to the circumference of a great circle of a given 
sphere. The height of the cylinder is equal to the radius of a 
great circle of that sphere. 

If the sphere is fitted snugly into this cylinder, the upper 
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inner perimeter of the cylinder will describe a great circle of 
that sphere on the sphere, no matter what the exact position 
of the sphere is in the cylinder, 

A word here is in order about materials. The author has used 
a number 6 tin can (cut off at the appropriate height) and a 
6" ball carrying a flat white paint coating. A larger sphere and 
cylinder and a black surface to be marked with chalk would be 
somewhat better.® 

Two strips should each be made up as follows; Take a strip 
of paper of from three-eighths to one-half of an inch in width. 
Mark off on this strip a distance equal to half the circumference 
of a great circle of the sphere. Divide this distance into 1 80 parts 
to represent 180 degrees. On the same strip of paper mark off' 
the cosines of the angles indicated on the strip. These cosine 
values, like correlation coefficients, will of course run from 
+ 1. 00 at o degrees, through o at 90 degrees to — 1.00 at 180 
degrees. This strip is now ready for use. It will become obvious 
to the reader that in actual operation the strip need not have 
indicated the angle values of the cosines. 

Paste one of the strips around the outside of the top perimeter 
of the cylinder. (This strip will be referred to hereafter as “the 
fixed strip.”) 

Label any point on the sphere “A.” Rest the sphere in the 
open end of the cylinder with the “ +1 .00” (the cosine value of 
an angle of zero degrees) of the fixed strip at "A.” At the point 
on the fixed strip corresponding to rj S mark “B” on the sphere. 
Draw AB along the edge of the cylinder, continuing this arc to 
L so that AL = 90°. 

Still keeping point A of the sphere at the “+1.00” of the 
fixed strip, move the arc ABL away from the edge of the cyl- 
inder. Keeping the sphere always snug in the cylinder, note the 
point (mentally or overtly) on the fixed strip which corresponds 
to ru. With the" +1.00” of the second (movable) strip at point 
B on the sphere and held snugly against the surface, move the 
sphere about until the point on the movable strip corresponding 
to rn is superimposed on the point on the fixed strip corre- 
sponding to ru. Label this point C on the sphere. 


1 A sm&U hole should be punched in the bottom of the can to allow air to escape. 
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The sides HC anti „/<? of the required spherical triangle may 
be readily drawn by connecting A to C along the edge of the 
cylinder with the sphere at rest, and B to C in like fashion. 

All, BC , and AC should be extended so that, as Indicated in 
Fig. VI : 

Al. «* AF «*> BJ » BH =“ Cl «* CG =■ 90° ( or from +1 to o 
or — 1 to o on the strip). 

This may best be accomplished by extending these sides the 
required amount along the perimeter of the cylinder at the same 
time that the sides of the spherical triangle are drawn. Move 
the sphere around in the cylinder until point Fof Fig. VI is at 



Fig. IV F'r V 


the "+l.oo” point of the fixed strip and point L is on the 
perimeter of the cylinder somewhere along the extent of the 
fixed strip. The reading on the fixed strip at point L corre- 
sponds to rja.s (Fig. VII). The other partial correlation 
coefficients are obtained in similar fashion. (Cosine “distances 
along the fixed strip from " +1.00” between points G and I, rsi.r, 
and J and //, rw.s; as in Fig. VI or III.) 

To obtain the multiple R’a most easily, we proceed as follows: 

Place point C of the sphere at +i>o° of the fixed strip and 
adjust the sphere until the perimeter of the cylinder describes 
an arc perpendicular to the side AB of the triangle 1 

may be judged quite accurately by adjusting the sphere until 
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AB is parallel to the vertical markings on the fixed strip. The 
reading on the fixed strip at the point of intersection, 
equals Rim- 

I 


s 

s 



Fig. VII Fig. VIII 


If the reader does not trust his judgment in estimating the 
point of perpendicularity, he may lay the edge of his movable 
strip along arc AB and move the sphere about until the edge 
of this strip coincides in direction with markings on the fixed 
strip (keeping point C always at +1.00). 

The other multiple-correlation coefficients may be obtained 
in a similar manner. 
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Evaluation of this Procedure 

The author was able to average about 4 minutes per problem 
of determining the 3 multiple and 3 partial correlation coeffi- 
cients from three zero order correlation coefficients. This is com- 
pared to a probable 1 5 minutes for most people for running such 
a problem off from the usual formulae on a calculator. 

The method may be very accurate, but is, however, depend- 
ent on the materials used and the carefulness of the computer. 

It is admitted, however, that the setting up of the equip- 
ment, simple though it is, is not worthwhile unless a large num- 
ber of such problems is expected to be encountered. 


fhc Use of this Procedure as a ’Peaching Device 

The relationship between certain trigonometric functions and 
coefficients of correlation and the methods of graphical compu- 
tation based on these relationships shown here, lend themselves 
to use in the teaching of statistics courses on the elementary or 
advanced level. 

Close consideration and use of these graphical methods may 
well serve to give the student a clearer and more functional 
understanding of the inter-relationships of partial and multiple- 
correlation coefficients, their dependence on one another for 
magnitude and direction, the dependence of both sets of varia- 
bles on zero-order correlation coefficients, the assumptions in- 
volved in their determination, the limitations of magnitude, and 
possibly more important than all the rest, a clearer picture or 
the concepts of orthogonality and angular measurement o 
relationship in correlation so important to the study and under- 
standing of factor analysis. 
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PREPARATION OF PROFILE CHARTS ON THE 
IBM TABULATOR 

FREDERIC M LORD 
Educational Testing Service 

An examinee's performance on a battery of tests may be re- 
ported graphically in the form of a profile chart or psychograph 
by means of the I.B.M. Type 405 Alphabetic Accounting Ma- 
chine. Such a profile is shown in the illustration. The examinee’s 
performance is shown graphically by means of a “o" symbol 
printed by the tabulator at the appropriate height on the chart 
corresponding to the examinee’s decile standing on each test in 
the battery. In the illustration the zero symbols have been con- 
nected by straight lines, but the drawing of these lines is not 
essential. 

If each examinee has as many I.B.M. cards as he has test 
scores, the printing of such a chart is a simple matter. The 
present discussion is concerned with the case where there is 
only one I.B.M. card for each examinee, and there is a sufficient 
number of scores per examinee to make it uneconomical or 
undesirable to prepare as many cards per examinee as there will 
be lines on the profile chart. 

For preparation of such charts in quantity a specially printed 
continuous-paper form would ordinarily be prepared for use on 
the tabulator. By use of an automatic carriage, profiles of the 
type illustrated can be run at the rate of about six per minute, 
including time for form-to-form ejection. If a profile based on 
quintiles rather than deciles is satisfactory, it can be obtained, 
after making wiring changes that will suggest themselves, at 
almost twice this speed. 

If percentile ranks are not readily available, profile charts 
may be run from cards containing the examinee’s scaled scores 
by the same method. Interpretation of charts prepared in this 
fashion will be facilitated by printing on the forms, in advance, 
the percentile ranks corresponding to the scaled score points 
appearing there. 

7 *« 
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In order to run the profiles ten blank cards are placed in front 
of a deck of cards, each of which contains the name and per- 
centile ranks of one examinee, and 10 more blank cards are 
placed behind the deck. On the first run through the machine 
a profile will be printed from every eleventh card. The blank 

PIFCIKIIIE RARE 


TEST: X II III IV V VI VII Till 
61 4 95 IS 73 93 63 34 



cards and the cards of the remaining examinees serve during 
this run only to provide the ten extra cycles necessary for the 
printing of the profile. 

After the first run, one blank card is removed from in front of 
the deck and all cards are run through the tabulator again. 
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Another blank card is then removed from in front of the deck 
and the procedure is repeated until eleven complete runs have 
been made. One profile for each examinee will thus have been 
obtained. 

For simplicity, the wiring diagram shows only the wiring 
necessary for the case when there is only one percentile rank for 
each examinee. Wiring for ejecting each profile chart after each 
minor total cycle is not shown. Each additional percentile rank 
per student requires an additional set of wires like those labeled 
B, C, I, J, and K. It is assumed for the purposes of the diagram 
that the examinee’s name is punched in columns 21 through 40 
of the card, and that his percentile rank is in columns 75 and 76. 
The explanation of the wiring diagram is as follows : 

A. The name is wired to print. 

B. The second digit of the percentile rank is wired to print. 

C. The first digit of the percentile rank is wired to print for 
the first card of each group. 

D. A card count is added into the left-hand position of 
counter 8B for all but the first card of each group. 

E. The carry impulse emitted by counter 8B after the first 
10 cards and after every eleven succeeding cards causes a 
minor control change. 

F. The long hammer levers are impulsed on every control 
cycle. (The switches are set and the long hammer levers are 
raised to suppress listing of the name and of the second digit of 
the percentile rank on all cards except the first card in each 
control group.) 

G. Selector F is picked up after each minor cycle. 

H. The paper form is made to advance an extra space after 
printing of the name. 

I. The first digit of the percentile rank is entered into counter 
8A from the first card of each group. A card count is added into 
8A for all other cards in the group. (This counter must be 
cleared on minor class of total.) 

J. Counter 8A emits a carry impulse whenever the amount 
in the counter has accumulated to ten. The Cl impulse is wired 
to a type bar entry, but printing is suppressed by means of a 
short hammerlock. The impulse serves to make the type bar 




Figure II. Wiring Diagram 
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to the right print a “o” symbol. This “o" is the symbol used 
to indicate graphically on the profile the performance of the 
examinee. 

K. This wiring will cause a zero to print on an alphamerical 
type bar. Where numerical type bars are used, this wiring is 
unnecessary. 

Short and long h ammo-locks to be raised are noted above. 
A zero split should be raised on the type bar carrying the last 
letter of the name and on the type bar carrying the last digit 
of each percentile rank. The tabulator is set to list (preferably 
with double or triple spacing for the sake of appearance), the 
hammerlock control switch is turned to no-X suppress, and the 
other switches are kept in their usual positions. 




THE THIRD MENTAL MEASUREMENTS YEARBOOK 

A REVIEW 
by 

Max D. Engelhart 
The Chicago City Junior College 

Oscar Krisen Buros, Editor. The Third Mental Measurements "Year- 
book. New Brunswick, N. J.: Rutgers University Press, 1949, 
PP- io 47- 

Everyone interested in educational or psychological measurement 
is indebted to Oscar Buros and his collaborators for producing the 
Mental Measurements Yearbooks. The impressive and indispensable 
current volume lists 663 tests, 713 original reviews by 320 reviewers, 
66 excerpts of reviews published elsewheie, and 3,36 3 references on 
specific tests. An effort has been made to list all commercially available 
tests published in English-speaking countries between October, 1940, 
and December, 1947. Also included are reviews of selected older tests 
and tests published during the period 1933-1948 not previously 
covered in the earlier publications of this series. The section entitled 
“Books and Reviews” lists 549 books on measurements and closely 
related fields, and 785 excerpts from reviews of these books. As in the 
case of tests, an effort was made to list all such books published be- 
tween October, 1940. and December, 1947. Older books are also listed 
when accompanied by review excerpts not published in the earlier 
yearbooks. 

Most of the important tests have been reviewed independently by 
two or more reviewers and it is satisfying to note the consistency of 
these reviews. One is also impressed by the frequency with which re- 
viewers have based their judgments on more than a study of the tests 
and the test manuals. Some of the reviewers have included in their 
reviews summarizations of the literature pertaining to the tests re- 
viewed. Other reviewers have written on the basis of experience in 
using the tests. Relatively few of the reviews seem superficial. Most 
of the reviews appear sincere and constructively critical A number of 
the reviews are excellent discussions of important problems of educa- 
tional and psychological measurement The use of the Yearbook should 
not be restricted to the selection of tests. The student will find it a 
valuable means of increasing his general knowledge and understanding 
of measurement. Anyone engaged in the production of a test can learn 
what he must do if he is not ultimately to be criticized. The user of 
tests cannot help but be made more sensitive to the limitations of test 
data. One gains from the volume as a whole an appraisal of the present 
status of testing which can be found m no other single source. 

Achievement testers will find particularly helpful the reviews of 
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achievement batteries and of tests in the various subject-matter fields. 
Clinical psychologists and psychiatrists will find of greatest interest 
the numerous reviews, review excerpts, and bibliographical references 
relevant to projective and other techniques useful m the measure- 
ment of personality. All persons engaged in guidance and counseling 
will also be interested in the wealth of information pertaining to in- 
telligence testing, to the testing of vocational aptitudes, and to interest 
inventories. Similar comments could be made with respect to the ex- 
cerpts of reviews of books on measurement and related fields. 

The current volume testifies to improvements in testing. A number 
of achievement tests are now available which evaluate more than the 
retention of traditional subject-matter information. Advances have 
been made in the measurement of intelligence, of character and 
personality, and of vocational interests and aptitudes. But few instru- 
ments are free from serious criticism. In achievement testing the fre- 
quent criticisms are lack of validity with respect to worth-while 
educational objectives, dubious dependability of norms, failure to re- 

E ort adequate data with respect to both validity and reliability, cum- 
ersome directions for administration, inefficient scoring procedures, 
and lack of care in the writing of exercises. Only a few achievement 
tests have adequate manuals. A number of tests claimed to be diagnos- 
tic should only be used to survey achievement. The chief criticisms 
of personality tests are with respect to validity and with the frequent 
lack of efforts to determine it. Intelligence tests are praised which 
measure more than verbal scholastic aptitude. A number are criticized 
for not bein^ factorially pure, for brevity, for use of IQ’s inappro- 
priately obtained, for inadequacy of norms, for meagerness of data on 
reliability and validity, and for violation of other aspects of good test 
construction. 

Some of the reviewers of achievement tests mention lack of validity 
for use in progressive schools. In the opinion of the writer some of the 
criticism of the test producers might well be directed toward educators 
in general. If the objectives of education are traditional, can testers be 
blamed for constructing tests largely in terms of such objectives? One 
may hypothesize that the really effective testing of achievement is 
currently accomplished, not by the commercially available achieve- 
ment tests, but By tests produced for local use by test technicians of 
college examining boards or of city school systems working in close 
collaboration with teachers. 

In concluding this review something should be said with respect to 
the use of the Yearbook in the Selection of tests. One needs often to 
consult the earlier volumes of the series for additional reviews to se- 
cure the information needed for a fair evaluation of a test. Consider- 
ation. should also be given to the possibilities that more recently pub- 
lished test forms than those reviewed may be free from some of the 
defects criticized and that the test authors may have been impelled 
to collect better data with respect to validity, reliability, and norms. 
Unfortunately, these possibilities are too seldom realized. In addition 
to reading the reviews and references pertaining to tests considered for 
use, it is advisable to examine the tests themselves and to have others 
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. „ For example, *m planning an achievement testing program, 
otnarirm of the tests considered should involve the participation of 
representative teachers and, if possible, preliminary trial of the tests 
Sore widespread use. The establishment of local norms and the sup- 
i.mentation of the commercial tests by locally constructed ones is 
0W1 advocated by the writer. The valid measurement of more compre- 
hensive ranges of educational objectives cannot otherwise be accom- 
nllshed-particularly those objectives which have to do with critical 
thinking in various subject-matter fields and with the attitudes, ideals, 
and interests developed in them. 
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ADDITIONAL INFORMATION ON CADET PERSONNEL PROBLEMS 


Professor T Ernest Newland, Director of the Psychological Clinic at the University 
of Tennessee, has received the following information from Dr. Sidney H, Newman, 
Senior Psychologist, Division of Commissioned Officers, Public Health Service, with 
reference to Professor Newland’s article, "Cadet Personnel Problems and Procedures 
at the United States Military Academy,” which appeared in this journal, Autumn, 
1947 : 

"The Coast Guard Academy obtained a ‘full-time professional psychologist' in the 
person of one J. M, Bobbitt in October 1942, and added one S. H. Newman in April 
1943. These two psychologists were in continual service until January 1946, and one 
psychologist has been continuously on duty at the Academy since that time.” 
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